-- Logs begin at Tue 2022-01-18 19:44:39 UTC, end at Tue 2022-01-18 20:44:15 UTC. -- Jan 18 20:14:33.733652 dv-cinder-821602-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 18 20:14:33.744264 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 18 20:14:33.746115 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jan 18 20:14:33 2022] *** Jan 18 20:14:33.746115 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 18 20:14:33.746115 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 18 20:14:33.746115 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: nodename: dv-cinder-821602-14-iscsi Jan 18 20:14:33.746115 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: machine: x86_64 Jan 18 20:14:33.746115 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: clock source: unix Jan 18 20:14:33.746115 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: pcre jit disabled Jan 18 20:14:33.746115 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: detected number of CPU cores: 4 Jan 18 20:14:33.746115 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: current working directory: / Jan 18 20:14:33.746115 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: detected binary path: /usr/bin/uwsgi-core Jan 18 20:14:33.746115 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: your processes number limit is 47680 Jan 18 20:14:33.746115 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: your memory page size is 4096 bytes Jan 18 20:14:33.746115 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: detected max file descriptor number: 2048 Jan 18 20:14:33.746115 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: lock engine: pthread robust mutexes Jan 18 20:14:33.747131 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: thunder lock: enabled Jan 18 20:14:33.747131 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 18 20:14:33.747131 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 18 20:14:33.791610 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: Python main interpreter initialized at 0x5576def4c9c0 Jan 18 20:14:33.791610 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: python threads support enabled Jan 18 20:14:33.791610 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: your server socket listen backlog is limited to 100 connections Jan 18 20:14:33.791610 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: your mercy for graceful operations on workers is 90 seconds Jan 18 20:14:33.792206 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: mapped 403077 bytes (393 KB) for 2 cores Jan 18 20:14:33.792206 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: *** Operational MODE: preforking *** Jan 18 20:14:33.792374 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: *** uWSGI is running in multiple interpreter mode *** Jan 18 20:14:33.792374 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: spawned uWSGI master process (pid: 101917) Jan 18 20:14:33.792490 dv-cinder-821602-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 18 20:14:33.793047 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: spawned uWSGI worker 1 (pid: 101918, cores: 1) Jan 18 20:14:33.796532 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: spawned uWSGI worker 2 (pid: 101919, cores: 1) Jan 18 20:14:33.796532 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 18 20:14:35.575116 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 18 20:14:35.575116 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: from cryptography.utils import int_from_bytes Jan 18 20:14:35.575820 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 18 20:14:35.575820 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: from cryptography.utils import int_from_bytes Jan 18 20:14:35.609535 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 18 20:14:35.609535 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: from cryptography.utils import int_from_bytes Jan 18 20:14:35.610160 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 18 20:14:35.610160 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: from cryptography.utils import int_from_bytes Jan 18 20:14:38.191123 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 18 20:14:38.191798 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 18 20:14:38.192152 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 18 20:14:38.192255 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 18 20:14:38.192343 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 18 20:14:38.192429 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 18 20:14:38.192513 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 18 20:14:38.192593 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 18 20:14:38.192669 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 18 20:14:38.192744 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 18 20:14:38.192819 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.192917 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.193040 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.193187 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.193359 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.193449 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.193678 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.193775 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.194006 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.194093 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.194321 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.194454 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.195239 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.195362 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.195604 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.195710 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.195891 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.196066 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.196148 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.196231 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.196456 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.196555 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.196782 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821602-14-iscsi {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.196876 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821602-14-iscsi {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.197104 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.197196 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.197412 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.197503 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.197724 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.197815 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.198041 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.198178 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.198344 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.198478 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.198662 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.198785 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.198977 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.199076 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.199501 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.199617 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.200780 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.200984 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.200984 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.201368 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.201568 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.201716 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.201891 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.202067 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.202241 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.202449 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.202638 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.202786 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.202996 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.203159 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.203333 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.203507 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.203722 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.203910 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.204064 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.204273 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.204463 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821602-14-iscsi {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.204655 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821602-14-iscsi {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.204805 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.204977 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.205192 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.205373 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.205527 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.205678 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.205807 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.205964 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.206088 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.206222 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.206222 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.206493 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.206622 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.206744 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.206864 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.206984 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.207157 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.207292 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.207414 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.207535 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.207723 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.207855 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.207977 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.208106 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.208235 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.208390 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.208513 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.208633 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.208761 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.208892 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.209012 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.209138 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.209259 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.209379 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.209511 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.209632 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.209752 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.209872 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.209998 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.210122 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.210254 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.210375 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.210504 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.210632 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.210760 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.210901 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.211102 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.211232 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.211401 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.211530 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.211652 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.211782 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.211905 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.212039 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.212167 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.212335 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.212475 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.212607 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.212736 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.212857 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.212976 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.213101 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.213230 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.213352 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.213479 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.213614 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.213736 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.213863 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.213997 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.214118 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.214237 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.214357 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.214483 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.214611 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.214742 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.214870 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.214991 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.215162 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.215295 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.215425 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.215546 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.215667 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.215937 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.216062 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.216182 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.216314 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.216490 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.216616 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.216833 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.216969 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.217153 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.217289 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.217465 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.217591 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.217785 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.217901 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.218108 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.218212 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.218418 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.218525 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.218722 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.218826 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.219056 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.219147 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.219367 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.219453 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.219701 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.219786 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.220005 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.220093 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.220255 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.220341 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.220558 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.220719 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.220866 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.221008 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.221182 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.221314 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.221472 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.221617 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.221815 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.221939 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.222061 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.222189 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.222362 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.222533 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.222664 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.222794 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.222959 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.223138 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.223290 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.223428 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.223597 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.223727 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.223900 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.224023 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.224207 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.224342 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.224510 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.224639 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.224814 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.224936 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.225116 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.225251 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.225432 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.225567 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.225773 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.225899 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.226078 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.226219 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.226383 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.226507 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.226688 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.226898 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.227073 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.227198 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.227334 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.227468 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.227619 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.227753 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.227929 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.228047 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.228253 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.228349 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.228555 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.228650 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.228858 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.228963 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.229175 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.229270 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.229483 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.229583 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.229789 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.229884 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.230106 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.230200 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.230406 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.230501 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.230735 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.230837 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.231021 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.231123 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.231347 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.231453 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.231650 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.231738 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.231954 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.232045 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.232255 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.232339 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.232560 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.232654 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.232859 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.232943 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.233160 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.233251 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.233465 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.233559 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.233761 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.233846 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.234080 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.234174 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.234400 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.234484 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.234710 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.234797 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.235016 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.235140 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.235338 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.235434 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.235659 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.235751 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:14:38.235992 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.236089 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.236326 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.236420 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.236664 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.236767 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.236978 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.237077 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.237309 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.237409 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.237641 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.237747 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.237958 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.238050 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.238269 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.238354 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.238584 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.238675 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.238909 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.238998 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.239245 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.239343 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.239557 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.239643 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.239870 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.239967 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.240186 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.240270 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.240504 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.240597 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.240831 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.240941 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.241147 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.241760 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.241993 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.242083 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.242313 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.242402 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.242631 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.242749 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.242939 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.243145 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.243291 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.243378 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.243615 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.243701 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.243925 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.244021 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.244267 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.244353 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.244611 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.244697 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.244924 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.245016 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.245248 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.245338 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.245558 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.245657 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.245886 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.246046 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.246191 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.246279 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.246502 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.246595 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.246816 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.246910 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.247165 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.247255 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.247478 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.247573 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.247791 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.247881 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.248125 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.248254 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.248443 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.248530 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.248760 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.248854 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.249066 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.249152 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.249370 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.249464 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.249676 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.249764 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.249988 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.250079 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.250291 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.250389 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.250610 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.250696 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.250936 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.251024 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.251268 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.251371 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.251601 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.251695 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.251911 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.252022 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.252217 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.252316 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.252525 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.252617 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.252835 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.252932 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.253142 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.253236 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.253455 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.253542 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.253759 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.253850 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.254084 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.254170 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.254393 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.254478 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.254700 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.254834 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.255021 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.255163 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.255352 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.255436 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.255656 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.255751 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.255972 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.256058 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.256278 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.256364 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.256590 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.256683 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.256970 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.257590 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.257817 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.257911 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.258133 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.258228 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.258445 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.258535 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.258781 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.258880 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.259146 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.259250 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.259454 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.259542 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.259780 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.259867 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.260106 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.260210 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.260423 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.260507 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.260729 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.260816 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.261046 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.261140 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.261355 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.261448 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.261668 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.261755 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.261979 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.262291 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.262602 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.262917 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.263098 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.263247 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.263381 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.263555 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.263713 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.263862 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.264039 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.264189 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.264361 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.264502 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.264811 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.265119 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.265206 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.265428 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.265547 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.265777 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.265869 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.266089 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.266177 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.266407 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.266494 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.266724 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.266810 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.267057 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.267148 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.267411 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.267498 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.267729 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.268049 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.268366 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.268684 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.269006 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.269163 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.269314 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.269506 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.269632 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.269858 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.269956 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.270198 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.270291 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.270537 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.270626 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.270864 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.270964 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.271203 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.271292 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.271530 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.271628 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.271840 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.271928 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.272166 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.272532 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.272870 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.273184 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.273289 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.273507 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.273594 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.273825 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.273917 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.274179 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.274284 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.274455 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.274544 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.274773 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.274869 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.275113 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.275302 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.275432 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.275508 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.275756 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.275842 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.276066 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.276152 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.276388 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.276474 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.276702 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.276788 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.277031 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.277118 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.277347 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.277436 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.277670 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.277757 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.277980 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.278067 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.278299 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.278385 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.278613 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.278697 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.278931 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.279042 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.279289 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.279391 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.279609 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.279703 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.279934 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.280022 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.280249 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.280335 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.280562 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.280661 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.280875 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.280969 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.281183 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.281275 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.281493 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.281587 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.281807 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.281894 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.282114 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.282198 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.282431 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.282537 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.282744 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.282851 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.283109 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.283227 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.283387 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.283488 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.283700 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.283785 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.284007 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.284094 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.284315 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.284402 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.284623 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.284708 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.284938 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.285023 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.285246 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.285346 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.285562 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.285695 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.285870 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.285965 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.286178 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.286266 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.286487 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.286581 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.286798 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.286889 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.287132 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.287222 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.287443 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.287538 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.287752 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.287847 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.288058 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.288747 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.288915 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.289051 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.289223 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.289349 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.289538 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.289626 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.289864 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.289952 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.290188 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.290283 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.290502 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.290598 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.290811 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.290906 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.291151 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.291259 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.291468 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.291555 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.291779 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.291914 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.292097 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.292323 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.292513 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.292650 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.292750 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.292936 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.293033 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.293293 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.293392 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.293606 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.293694 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.293917 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.294016 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.294227 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.294313 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.294541 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.294628 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.294854 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.294956 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.295184 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.295272 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.295499 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.295602 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.295815 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.295912 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.296140 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.296397 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.296484 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.296985 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.297082 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.297305 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.297392 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.297618 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.297702 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.297933 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.298027 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.298249 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.298336 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.298574 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.298662 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.298887 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.298985 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.299231 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.299326 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.299542 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.299628 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.299849 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.299942 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.300157 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.300266 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.300466 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.300554 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.300779 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.301035 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.301128 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.301370 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.301456 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.301679 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.301774 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.301998 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.302125 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.302301 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.302389 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.302613 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.302748 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.302938 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.303062 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.303271 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.303427 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.303595 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.303678 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.304443 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.304540 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.304767 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.304884 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.305069 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.305162 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.305375 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.305461 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.305690 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.305782 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.305997 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.306094 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.306302 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.306388 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.306609 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.306694 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.306920 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.307016 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.307253 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.307342 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.307561 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.307647 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.307911 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.308006 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.308221 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.308322 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.308542 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.308636 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.308849 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.308974 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.309168 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.309255 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.309474 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.309558 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.309788 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.309881 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.310095 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.310183 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.310401 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.310486 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.310709 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.310823 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.311012 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.311160 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.311349 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.311438 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.311664 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.311764 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.311977 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.312107 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.312288 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.312376 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.312595 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.312737 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.312915 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.313026 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.313217 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.313304 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.313538 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.313654 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.313836 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.313928 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.314143 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.314229 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.314448 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.314535 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.314759 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.314849 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.315090 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.315179 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.315399 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.315486 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.315709 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.315801 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.316014 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.316100 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.316323 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.316410 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.316627 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.316712 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.316929 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.317021 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.317233 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.317326 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.317534 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.317619 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.317842 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.317940 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.318147 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.318234 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.318449 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.318534 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.318756 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.318856 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.319082 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.319171 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.319415 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.319500 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.319722 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.319828 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.320027 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.320113 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.320331 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.320417 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.320639 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.320741 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.320965 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.321053 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.321284 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.321379 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.321594 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.321682 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.321907 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.321996 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.322215 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.322302 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.322519 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.322605 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.322825 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.322914 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.323176 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.323268 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.323485 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.323573 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.323790 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.323877 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.324100 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.324192 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.324405 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.324491 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.324709 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.324794 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.325021 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.325117 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.325329 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.325414 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.325637 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.325722 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.325942 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.326037 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.326248 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.326336 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.326553 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.326638 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.326863 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.326959 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.327192 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.327280 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.327506 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.327604 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.327811 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.327948 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.328115 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.328203 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.328418 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.328505 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.328723 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.328817 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.329033 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.329120 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.329356 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.329442 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.329665 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.329754 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.329972 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.330059 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.330277 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.330374 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.330581 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.330669 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.330889 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.330974 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.331244 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.331334 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.331564 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.331659 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.331881 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.331969 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.332206 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.332303 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.332524 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.332610 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.332838 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.332931 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.333146 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.333243 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.333460 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.333547 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.333767 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.333853 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.334076 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.334172 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.334384 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.334469 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.334695 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.334779 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.335086 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.335192 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.335378 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.335467 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.335696 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.335784 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.336012 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.336106 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.336329 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.336430 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.336642 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.336763 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.336957 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.337088 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.337272 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.337415 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.337581 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.337721 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.337911 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.338031 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.338225 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.338343 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.338533 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.338713 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.338851 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.339086 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.339186 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.339404 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.339490 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.339720 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.339816 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.340033 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.340203 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.341228 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.341339 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.341432 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.341514 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.341592 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.341678 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.341757 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.341835 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.341921 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.342001 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.342087 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.342166 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.342244 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.342345 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.342442 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.342656 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.342765 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.343052 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.343139 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.343374 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.343478 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.343682 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.343778 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.343995 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.344083 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.344302 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.344390 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.344620 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.344738 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.344936 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.345054 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.345263 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.345351 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.345573 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.345659 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.345882 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.345976 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.346187 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.346282 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.346513 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.346600 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.346823 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.346916 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.347168 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.347260 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.347591 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.347677 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.347903 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.348001 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.348211 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.348304 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.348526 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.348640 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.348938 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.349041 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.349244 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.349334 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.349559 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.349655 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.349887 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.349987 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.350195 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.350281 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.350502 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.351112 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.351357 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.351457 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.351681 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.351768 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.351988 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.352083 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.352309 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.352397 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.352628 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.352714 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.352949 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.353084 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.353258 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.353347 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.353584 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.353722 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.353910 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.354036 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.354231 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.354346 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.354558 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.354656 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.354977 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.355113 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.355345 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.355440 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.355649 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.355735 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.355965 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.356065 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.356275 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.356371 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.356592 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.356678 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.356904 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.356998 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.357213 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.357299 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.357520 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.357627 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.357821 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.357914 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.358144 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.358240 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.358451 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.358538 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.358789 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.358897 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.359106 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.359214 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.359424 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.359545 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.359732 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.359873 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.360041 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.360189 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.360372 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.360513 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.360680 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.360841 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.361008 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.361148 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.361328 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.361453 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.361655 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.361749 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.361981 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.362068 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.362292 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.362378 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.362619 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.362707 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.362934 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.363085 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.363269 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.363355 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.363581 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.363667 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.363888 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.363975 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.364194 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.364296 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.364506 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.364669 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.364812 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.364950 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.365121 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.365274 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.365434 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.365592 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.365740 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.365838 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.366064 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.366151 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.366953 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.367093 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.367285 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.367374 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.367612 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.367706 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.367923 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.368020 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.368230 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.368318 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.368537 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.368622 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.368843 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.368931 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.369150 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.369242 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.369458 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.369546 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.369766 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.369853 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.370080 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.370173 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.370393 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.370487 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.370700 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.370789 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.371006 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.371142 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.371355 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.371454 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.371662 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.371752 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.371987 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.372074 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.372300 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.372394 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.372603 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.372688 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.372909 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.373002 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.373216 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.373316 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.373522 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.373607 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.373830 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.373918 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.374138 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.374233 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.374450 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.374537 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.374756 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.374849 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.375088 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.375212 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.375398 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.375495 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.375722 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.375809 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.376028 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.376117 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.376351 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.376437 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.376662 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.376749 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.376970 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.377097 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.377281 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.377371 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.377588 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.377676 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.377905 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.377993 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.378218 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.378314 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.378537 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.378631 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.378855 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.378941 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.379193 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.379282 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.379527 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.379767 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.379854 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.380098 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.380185 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.380420 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.380507 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.380736 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.380824 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.381051 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.381139 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.381366 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.381451 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.381679 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.381766 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.382054 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.382141 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.382376 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.382691 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.382794 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.383039 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.383207 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.383370 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.383689 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.383787 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.384176 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.384263 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.384512 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.384601 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.384846 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.384946 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.385170 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.385256 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.385487 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.385583 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.385803 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.385900 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.386118 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.386211 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.386431 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.386525 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.386746 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.386834 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.387163 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.387263 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.387404 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.387491 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.387734 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.387822 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.388055 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.388150 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.388373 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.388466 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.388692 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.388779 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.389009 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.389102 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.389329 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.389428 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.389645 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.389730 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.389958 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.390043 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.390278 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.390373 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.390599 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.390686 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.390918 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.391010 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.391262 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.391351 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.391581 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.391675 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.391899 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.391996 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.392215 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.392303 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.392529 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.392621 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.392846 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.392947 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.393161 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.393387 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.393510 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.393707 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.393801 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.394045 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.394134 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.394380 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.394466 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.394704 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.394797 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.395037 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.395125 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.395376 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.395460 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.395693 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.395782 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.396050 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.396137 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.396300 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.396389 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.396615 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.396825 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.396921 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.397145 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.397248 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.397505 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.397606 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.397833 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.397923 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.398158 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.398247 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.398477 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.398571 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.398790 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.398877 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.399155 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.399357 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.399470 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.399711 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.399811 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.400033 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.400177 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.400369 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.400457 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.400672 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.400760 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.400994 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.401082 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.401306 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.401392 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.401612 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.401705 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.401932 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.402018 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.402241 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.402333 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.402555 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.402771 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.402869 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.403147 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.403237 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.403467 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.403594 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.403784 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.403870 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.404096 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.404182 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.404403 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.404493 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.404739 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.404875 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.405012 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.405099 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.405329 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.405416 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.405637 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.405723 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.405941 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.406026 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.406250 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.406338 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.406554 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.406647 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.406862 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.406964 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.407193 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.407282 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.407510 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.407640 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.407819 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.407925 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.408125 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.408211 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.408430 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.408527 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.408741 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.408843 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.409049 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.409136 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.409357 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.409450 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.409663 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.409807 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.409973 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.410059 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.410282 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.410368 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.410589 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.410760 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.410895 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.410983 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.411224 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.411313 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.411536 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.411624 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.411841 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.411936 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.412155 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.412245 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.412462 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.412551 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.412775 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.412862 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.413597 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.413743 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.413919 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.414008 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.414249 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.414535 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.414623 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.414929 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.415054 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.415265 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.415363 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.415590 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.415679 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.415903 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.415999 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.416228 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.416316 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.416545 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.416640 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.416853 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.416942 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.417181 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.417268 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.417499 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.417600 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.417819 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.418067 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.418156 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.418433 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.418527 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.418753 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.418857 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.419097 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.419225 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.419401 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.419502 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.419716 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.419806 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.420030 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.420122 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.420357 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.420445 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.420675 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.420763 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.420993 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.421113 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.421300 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.421389 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.421873 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.421968 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.422185 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.422274 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.422495 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.422591 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.422804 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.422895 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.423143 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.423270 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.423456 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.423564 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.423773 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.423950 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.424094 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.424189 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.424406 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.424507 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.424717 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.424805 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.425032 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.425132 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.425348 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.425438 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.425665 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.425752 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.425976 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.426063 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.426285 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.426381 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.426594 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.426683 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.426904 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.426997 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.427243 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.427334 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.427571 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.427660 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.427890 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.428003 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.428200 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.428299 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.428579 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.428679 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.429469 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.429616 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.429794 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.429918 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.430103 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.430193 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.430411 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.430552 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.430716 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.430824 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.431045 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.431142 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.431362 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.431451 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.431682 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.431770 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.431991 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.432079 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.432318 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.432407 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.432633 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.432721 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.432957 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.433053 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.433271 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.433360 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.433575 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.433661 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.433880 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.434056 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.434189 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.434293 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.434482 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.434589 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.434811 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.434935 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.435154 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.435256 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.435472 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.435560 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.436705 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.436814 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.437638 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.437742 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.439375 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.439523 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.439647 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.439766 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.439874 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.439874 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.440072 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.440176 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.440297 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.440404 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.440508 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.440612 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.440765 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.442338 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.442513 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.442615 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.442615 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.442615 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.442863 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.442933 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.443014 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.443163 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.443232 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.443406 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.443508 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.443728 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.443817 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.444056 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.444204 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.444395 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.444526 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.444726 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.445056 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.445190 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.445388 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.445608 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.445705 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.446066 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.446162 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.446384 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.446685 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.446808 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.447044 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.447149 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.447393 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.447649 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.447796 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.448084 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.448314 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.448448 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.448651 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 18 20:14:38.448730 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.449046 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.449382 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.449705 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.450029 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.450353 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.450686 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.451020 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.451379 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.451712 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.452064 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.452381 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.452737 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.453070 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.453441 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.454021 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.454380 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:14:38.454630 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 18 20:14:38.473980 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_db.sqlalchemy.engines [None req-489e017a-9cf1-448d-bb74-fe4a1a4d3f51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 20:14:38.479501 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG oslo_db.sqlalchemy.engines [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 20:14:38.543523 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.context [None req-489e017a-9cf1-448d-bb74-fe4a1a4d3f51 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f3f10cc4-091c-4f8e-95bd-0bc3374e1059(cell1) {{(pid=101919) load_cells /opt/stack/nova/nova/context.py:464}} Jan 18 20:14:38.547942 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.context [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f3f10cc4-091c-4f8e-95bd-0bc3374e1059(cell1) {{(pid=101918) load_cells /opt/stack/nova/nova/context.py:464}} Jan 18 20:14:38.548071 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-489e017a-9cf1-448d-bb74-fe4a1a4d3f51 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:14:38.549617 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-489e017a-9cf1-448d-bb74-fe4a1a4d3f51 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:14:38.550426 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-489e017a-9cf1-448d-bb74-fe4a1a4d3f51 None None] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:14:38.552132 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:14:38.552413 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-489e017a-9cf1-448d-bb74-fe4a1a4d3f51 None None] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:14:38.553796 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:14:38.555151 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:14:38.557105 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG oslo_concurrency.lockutils [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:14:38.563503 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_db.sqlalchemy.engines [None req-489e017a-9cf1-448d-bb74-fe4a1a4d3f51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 20:14:38.568893 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_db.sqlalchemy.engines [None req-489e017a-9cf1-448d-bb74-fe4a1a4d3f51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 20:14:38.573346 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG oslo_db.sqlalchemy.engines [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 20:14:38.576662 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG oslo_db.sqlalchemy.engines [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 20:14:38.860821 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_db.sqlalchemy.engines [None req-489e017a-9cf1-448d-bb74-fe4a1a4d3f51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 20:14:38.863744 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG oslo_db.sqlalchemy.engines [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 20:14:39.209169 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: WARNING keystonemiddleware.auth_token [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 18 20:14:39.211676 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: WARNING keystonemiddleware.auth_token [None req-489e017a-9cf1-448d-bb74-fe4a1a4d3f51 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 18 20:14:39.217547 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: WARNING keystonemiddleware.auth_token [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 18 20:14:39.218423 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: WARNING keystonemiddleware.auth_token [None req-489e017a-9cf1-448d-bb74-fe4a1a4d3f51 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 18 20:14:39.558112 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: WARNING keystonemiddleware.auth_token [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 18 20:14:39.563663 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: WARNING keystonemiddleware.auth_token [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 18 20:14:39.569207 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5576def4c9c0 pid: 101918 (default app) Jan 18 20:14:39.570825 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: WARNING keystonemiddleware.auth_token [None req-489e017a-9cf1-448d-bb74-fe4a1a4d3f51 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 18 20:14:39.572041 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:14:39.573451 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001960 Jan 18 20:14:39.573865 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 788 bytes} [Tue Jan 18 20:14:39 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:14:39.576301 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: WARNING keystonemiddleware.auth_token [None req-489e017a-9cf1-448d-bb74-fe4a1a4d3f51 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 18 20:14:39.581543 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5576def4c9c0 pid: 101919 (default app) Jan 18 20:16:10.164744 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:16:10.165744 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jan 18 20:16:10.166150 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 2/2] 10.222.0.67 () {54 vars in 930 bytes} [Tue Jan 18 20:16:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:16:10.649851 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-b8dc45ec-f0fc-4cb1-8900-41238f34a71a admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:16:10.686421 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-b8dc45ec-f0fc-4cb1-8900-41238f34a71a admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.512456 Jan 18 20:16:10.687287 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 1/3] 10.222.0.67 () {60 vars in 1291 bytes} [Tue Jan 18 20:16:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:16:13.281410 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:16:13.282409 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-8549e57a-bc2a-4b69-9b91-78e8d3109de7 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jan 18 20:16:13.282804 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 3/4] 10.222.0.67 () {54 vars in 930 bytes} [Tue Jan 18 20:16:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:16:13.349642 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-206fd813-1b38-42e0-982e-136284ae4786 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "ram": 256, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:13.368032 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:16:13.368032 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: warnings.warn(msg) Jan 18 20:16:13.398634 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-206fd813-1b38-42e0-982e-136284ae4786 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106248 Jan 18 20:16:13.399518 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 2/5] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Jan 18 20:16:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:16:13.616828 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-7f417086-4900-4b5e-8171-91d1f34ef353 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:13.619488 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:16:13.619488 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: warnings.warn(msg) Jan 18 20:16:13.675725 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-7f417086-4900-4b5e-8171-91d1f34ef353 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.267643 Jan 18 20:16:13.676763 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 4/6] 10.222.0.67 () {64 vars in 1335 bytes} [Tue Jan 18 20:16:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:16:16.044901 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-206fd813-1b38-42e0-982e-136284ae4786 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:16:16.046474 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-206fd813-1b38-42e0-982e-136284ae4786 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002726 Jan 18 20:16:16.047093 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 3/7] 10.222.0.67 () {54 vars in 930 bytes} [Tue Jan 18 20:16:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:16:16.196738 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-885b01fe-b792-4fca-804a-b9050575c14c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:16.215383 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:16:16.215383 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: warnings.warn(msg) Jan 18 20:16:16.238108 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-885b01fe-b792-4fca-804a-b9050575c14c admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.184043 Jan 18 20:16:16.238671 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 5/8] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Jan 18 20:16:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:16:16.255750 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-60d2720e-6527-4301-a3a7-e67ace035039 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:16.258680 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:16:16.258680 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: warnings.warn(msg) Jan 18 20:16:16.319491 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-60d2720e-6527-4301-a3a7-e67ace035039 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071982 Jan 18 20:16:16.331086 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 4/9] 10.222.0.67 () {64 vars in 1335 bytes} [Tue Jan 18 20:16:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:16:18.776110 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-885b01fe-b792-4fca-804a-b9050575c14c admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:16:18.777127 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-885b01fe-b792-4fca-804a-b9050575c14c admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jan 18 20:16:18.777822 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 6/10] 10.222.0.67 () {54 vars in 930 bytes} [Tue Jan 18 20:16:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:16:18.849145 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-9012aa82-17a3-445a-9a23-c5068942e564 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G", "vcpus": 1, "id": "d2"}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:18.871673 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-9012aa82-17a3-445a-9a23-c5068942e564 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087136 Jan 18 20:16:18.879364 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 5/11] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Jan 18 20:16:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:16:18.884938 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-eea856df-97d6-4992-b172-e119e86159eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:18.911905 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-eea856df-97d6-4992-b172-e119e86159eb admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030714 Jan 18 20:16:18.919573 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 7/12] 10.222.0.67 () {64 vars in 1335 bytes} [Tue Jan 18 20:16:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:16:21.326281 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-9012aa82-17a3-445a-9a23-c5068942e564 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:16:21.327341 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-9012aa82-17a3-445a-9a23-c5068942e564 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jan 18 20:16:21.327745 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 6/13] 10.222.0.67 () {54 vars in 930 bytes} [Tue Jan 18 20:16:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:16:21.389621 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-6a6f7736-a24b-4b4a-9e74-3eef568b9f3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3", "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:21.410130 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-6a6f7736-a24b-4b4a-9e74-3eef568b9f3e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075253 Jan 18 20:16:21.410703 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 8/14] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Jan 18 20:16:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:16:21.423705 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-5515cff2-66c6-4963-9e94-c1941fa9716e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:21.456454 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-5515cff2-66c6-4963-9e94-c1941fa9716e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037009 Jan 18 20:16:21.457003 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 7/15] 10.222.0.67 () {64 vars in 1335 bytes} [Tue Jan 18 20:16:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:16:24.106468 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-6a6f7736-a24b-4b4a-9e74-3eef568b9f3e admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:16:24.109967 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-6a6f7736-a24b-4b4a-9e74-3eef568b9f3e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003769 Jan 18 20:16:24.110991 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 9/16] 10.222.0.67 () {54 vars in 930 bytes} [Tue Jan 18 20:16:24 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:16:24.182618 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-515fc1cc-933b-43ed-b872-35bda66507fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 4, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "id": "d4", "swap": 0}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:24.204772 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-515fc1cc-933b-43ed-b872-35bda66507fd admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083266 Jan 18 20:16:24.205743 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 8/17] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Jan 18 20:16:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:16:24.218780 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-d82c57ed-5e37-4bc1-a220-3bc9a8db8470 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:24.259365 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-d82c57ed-5e37-4bc1-a220-3bc9a8db8470 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044235 Jan 18 20:16:24.260540 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 10/18] 10.222.0.67 () {64 vars in 1335 bytes} [Tue Jan 18 20:16:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:16:26.841491 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-515fc1cc-933b-43ed-b872-35bda66507fd admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:16:26.842586 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-515fc1cc-933b-43ed-b872-35bda66507fd admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Jan 18 20:16:26.843252 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 9/19] 10.222.0.67 () {54 vars in 930 bytes} [Tue Jan 18 20:16:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:16:26.904420 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-65caafc5-541c-4acd-8129-24a556fbc2c7 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:16:26.928909 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-65caafc5-541c-4acd-8129-24a556fbc2c7 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078624 Jan 18 20:16:26.929688 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 11/20] 10.222.0.67 () {60 vars in 1291 bytes} [Tue Jan 18 20:16:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:16:29.648583 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-515fc1cc-933b-43ed-b872-35bda66507fd admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:16:29.649592 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-515fc1cc-933b-43ed-b872-35bda66507fd admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jan 18 20:16:29.650005 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 10/21] 10.222.0.67 () {54 vars in 930 bytes} [Tue Jan 18 20:16:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:16:29.748883 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-91b897e2-782b-4072-a352-55aca633a220 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:29.790612 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-91b897e2-782b-4072-a352-55aca633a220 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.134172 Jan 18 20:16:29.791490 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 12/22] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Jan 18 20:16:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:16:29.804866 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-fb5b8093-181c-447a-a159-721d2b135cc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:29.836010 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-fb5b8093-181c-447a-a159-721d2b135cc0 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035240 Jan 18 20:16:29.836653 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 11/23] 10.222.0.67 () {64 vars in 1332 bytes} [Tue Jan 18 20:16:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:16:32.303097 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-91b897e2-782b-4072-a352-55aca633a220 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:16:32.304328 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-91b897e2-782b-4072-a352-55aca633a220 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001750 Jan 18 20:16:32.304787 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 930 bytes} [Tue Jan 18 20:16:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:16:32.400729 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-d6e2885f-1565-4e63-ac98-87f65bba8cce admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "2", "disk": 20}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:32.428067 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-d6e2885f-1565-4e63-ac98-87f65bba8cce admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.114560 Jan 18 20:16:32.428735 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 12/25] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Jan 18 20:16:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:16:32.441220 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-e00eda94-21ab-4fe8-9d85-d8a427f6e846 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:32.464524 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-e00eda94-21ab-4fe8-9d85-d8a427f6e846 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026916 Jan 18 20:16:32.465114 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 14/26] 10.222.0.67 () {64 vars in 1332 bytes} [Tue Jan 18 20:16:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:16:35.117532 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-d6e2885f-1565-4e63-ac98-87f65bba8cce admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:16:35.118574 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-d6e2885f-1565-4e63-ac98-87f65bba8cce admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Jan 18 20:16:35.119071 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 13/27] 10.222.0.67 () {54 vars in 930 bytes} [Tue Jan 18 20:16:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:16:35.203473 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-97b7e67c-199e-46a9-87bd-a20a936bc6b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0, "disk": 40, "id": "3"}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:35.224200 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-97b7e67c-199e-46a9-87bd-a20a936bc6b9 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.097365 Jan 18 20:16:35.224200 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 15/28] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Jan 18 20:16:35 2022] POST /compute/v2.1/flavors => generated 406 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:16:35.235856 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-27ece1d8-b480-488e-92fe-966eb8cdba5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:35.264885 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-27ece1d8-b480-488e-92fe-966eb8cdba5d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032550 Jan 18 20:16:35.265482 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 14/29] 10.222.0.67 () {64 vars in 1332 bytes} [Tue Jan 18 20:16:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:16:37.651566 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-97b7e67c-199e-46a9-87bd-a20a936bc6b9 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:16:37.652578 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-97b7e67c-199e-46a9-87bd-a20a936bc6b9 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jan 18 20:16:37.653163 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 16/30] 10.222.0.67 () {54 vars in 930 bytes} [Tue Jan 18 20:16:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:16:37.718052 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-102ebe70-cf95-4aec-b487-8b0fa02b9648 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "id": "4", "rxtx_factor": 1.0, "name": "m1.large", "swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:37.738379 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-102ebe70-cf95-4aec-b487-8b0fa02b9648 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078617 Jan 18 20:16:37.738926 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 15/31] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Jan 18 20:16:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:16:37.751322 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-383e252b-ff1d-41ad-90ef-66752a408fd6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:37.776373 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-383e252b-ff1d-41ad-90ef-66752a408fd6 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028898 Jan 18 20:16:37.778002 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 17/32] 10.222.0.67 () {64 vars in 1332 bytes} [Tue Jan 18 20:16:37 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:16:40.080903 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-102ebe70-cf95-4aec-b487-8b0fa02b9648 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:16:40.082101 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-102ebe70-cf95-4aec-b487-8b0fa02b9648 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jan 18 20:16:40.082555 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 16/33] 10.222.0.67 () {54 vars in 930 bytes} [Tue Jan 18 20:16:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:16:40.150088 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-07368b18-7632-47d3-871e-5a6ca395aae1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "ram": 16384, "swap": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:40.170218 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-07368b18-7632-47d3-871e-5a6ca395aae1 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079325 Jan 18 20:16:40.171084 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 18/34] 10.222.0.67 () {64 vars in 1282 bytes} [Tue Jan 18 20:16:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:16:40.184309 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-d9bc29f8-4749-4f12-a33d-2ebe46734b69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:16:40.217152 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-d9bc29f8-4749-4f12-a33d-2ebe46734b69 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037169 Jan 18 20:16:40.231666 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 17/35] 10.222.0.67 () {64 vars in 1332 bytes} [Tue Jan 18 20:16:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:17:03.076796 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-07368b18-7632-47d3-871e-5a6ca395aae1 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:03.077804 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-07368b18-7632-47d3-871e-5a6ca395aae1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jan 18 20:17:03.078205 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 19/36] 10.222.0.67 () {54 vars in 930 bytes} [Tue Jan 18 20:17:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:17:03.135472 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-0bd73f7e-c530-4b06-a296-60c5358cdaf7 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:03.153187 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-0bd73f7e-c530-4b06-a296-60c5358cdaf7 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068117 Jan 18 20:17:03.153729 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 18/37] 10.222.0.67 () {60 vars in 1291 bytes} [Tue Jan 18 20:17:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:17:04.513281 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-07368b18-7632-47d3-871e-5a6ca395aae1 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:04.514286 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-07368b18-7632-47d3-871e-5a6ca395aae1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jan 18 20:17:04.514690 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 20/38] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Jan 18 20:17:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:17:04.709502 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-d9862f9a-e1c1-4c2b-9d40-8e358f089804 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:04.715404 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.wsgi [None req-d9862f9a-e1c1-4c2b-9d40-8e358f089804 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 18 20:17:04.715969 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-d9862f9a-e1c1-4c2b-9d40-8e358f089804 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:17:04.716766 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-d9862f9a-e1c1-4c2b-9d40-8e358f089804 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059719 Jan 18 20:17:04.717279 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 19/39] 10.222.0.67 () {60 vars in 1190 bytes} [Tue Jan 18 20:17:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 18 20:17:04.727593 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-68ac36d3-8f31-4f45-a55e-dd508023e181 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:04.748208 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-68ac36d3-8f31-4f45-a55e-dd508023e181 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024252 Jan 18 20:17:04.748780 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 21/40] 10.222.0.67 () {60 vars in 1210 bytes} [Tue Jan 18 20:17:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:17:04.760391 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-bcecf382-5273-461b-beaf-9363f37237b0 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:04.782767 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-bcecf382-5273-461b-beaf-9363f37237b0 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027522 Jan 18 20:17:04.784037 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 20/41] 10.222.0.67 () {60 vars in 1210 bytes} [Tue Jan 18 20:17:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:17:04.794782 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-27c0de5b-bfd3-4e9c-abe9-7a96ff26669e admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:04.800886 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.wsgi [None req-27c0de5b-bfd3-4e9c-abe9-7a96ff26669e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 18 20:17:04.801474 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-27c0de5b-bfd3-4e9c-abe9-7a96ff26669e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:17:04.802335 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-27c0de5b-bfd3-4e9c-abe9-7a96ff26669e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011347 Jan 18 20:17:04.802832 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 22/42] 10.222.0.67 () {60 vars in 1190 bytes} [Tue Jan 18 20:17:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 18 20:17:06.077029 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-bcecf382-5273-461b-beaf-9363f37237b0 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:06.078047 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-bcecf382-5273-461b-beaf-9363f37237b0 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jan 18 20:17:06.078470 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 21/43] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Jan 18 20:17:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:17:06.272976 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-6309d506-d56f-4ec0-9fa8-e16ed9298d58 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:06.278222 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.wsgi [None req-6309d506-d56f-4ec0-9fa8-e16ed9298d58 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 18 20:17:06.278787 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-6309d506-d56f-4ec0-9fa8-e16ed9298d58 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:17:06.279638 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-6309d506-d56f-4ec0-9fa8-e16ed9298d58 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058985 Jan 18 20:17:06.280153 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 23/44] 10.222.0.67 () {60 vars in 1190 bytes} [Tue Jan 18 20:17:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 18 20:17:06.290551 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-608f41a8-1c1a-4bd9-b9a1-4098e3e9c42e admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:06.305431 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-608f41a8-1c1a-4bd9-b9a1-4098e3e9c42e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018485 Jan 18 20:17:06.305985 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 22/45] 10.222.0.67 () {60 vars in 1210 bytes} [Tue Jan 18 20:17:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:17:06.316137 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-f4bee36a-a9d6-4635-82b4-273cb43e80c1 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:06.330516 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-f4bee36a-a9d6-4635-82b4-273cb43e80c1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018389 Jan 18 20:17:06.331092 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 24/46] 10.222.0.67 () {60 vars in 1210 bytes} [Tue Jan 18 20:17:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:17:06.340612 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-371d5c32-8cda-4cc5-946d-b171d691afc5 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:06.345937 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.wsgi [None req-371d5c32-8cda-4cc5-946d-b171d691afc5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 18 20:17:06.346500 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-371d5c32-8cda-4cc5-946d-b171d691afc5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:17:06.347340 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-371d5c32-8cda-4cc5-946d-b171d691afc5 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010273 Jan 18 20:17:06.347845 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 23/47] 10.222.0.67 () {60 vars in 1190 bytes} [Tue Jan 18 20:17:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 18 20:17:07.622850 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-f4bee36a-a9d6-4635-82b4-273cb43e80c1 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:07.624201 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-f4bee36a-a9d6-4635-82b4-273cb43e80c1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jan 18 20:17:07.625873 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 25/48] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Jan 18 20:17:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:17:07.819300 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-c80104ba-eab9-4479-94e1-6067d5c7e51c admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:07.824799 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.wsgi [None req-c80104ba-eab9-4479-94e1-6067d5c7e51c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 18 20:17:07.825367 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-c80104ba-eab9-4479-94e1-6067d5c7e51c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:17:07.826196 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-c80104ba-eab9-4479-94e1-6067d5c7e51c admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059204 Jan 18 20:17:07.826722 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 24/49] 10.222.0.67 () {60 vars in 1193 bytes} [Tue Jan 18 20:17:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 18 20:17:07.837027 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-f65dc389-21ba-4cb2-bac8-4623578c555c admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:07.851975 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-f65dc389-21ba-4cb2-bac8-4623578c555c admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018479 Jan 18 20:17:07.852543 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 26/50] 10.222.0.67 () {60 vars in 1210 bytes} [Tue Jan 18 20:17:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:17:07.862510 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-db89e921-45b4-4191-b6ae-ad9767756073 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:07.875833 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-db89e921-45b4-4191-b6ae-ad9767756073 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017227 Jan 18 20:17:07.876385 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 25/51] 10.222.0.67 () {60 vars in 1210 bytes} [Tue Jan 18 20:17:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:17:07.886818 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-16ad5b10-56d2-4eaa-88c1-0229dbb8e258 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:07.892850 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.wsgi [None req-16ad5b10-56d2-4eaa-88c1-0229dbb8e258 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 18 20:17:07.893440 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-16ad5b10-56d2-4eaa-88c1-0229dbb8e258 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:17:07.894238 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-16ad5b10-56d2-4eaa-88c1-0229dbb8e258 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011656 Jan 18 20:17:07.894801 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 27/52] 10.222.0.67 () {60 vars in 1193 bytes} [Tue Jan 18 20:17:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 18 20:17:09.159589 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-db89e921-45b4-4191-b6ae-ad9767756073 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:09.160597 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-db89e921-45b4-4191-b6ae-ad9767756073 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jan 18 20:17:09.160992 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 26/53] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Jan 18 20:17:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:17:09.354302 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-989104c1-1ba9-4aba-b90b-34e49989f3c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:17:09.372861 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-989104c1-1ba9-4aba-b90b-34e49989f3c6 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070264 Jan 18 20:17:09.373365 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 28/54] 10.222.0.67 () {64 vars in 1235 bytes} [Tue Jan 18 20:17:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:17:10.661147 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-db89e921-45b4-4191-b6ae-ad9767756073 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:10.662138 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-db89e921-45b4-4191-b6ae-ad9767756073 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jan 18 20:17:10.662531 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 27/55] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Jan 18 20:17:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:17:10.858024 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-acb09aba-8ca1-449d-96de-287ffdb80649 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:17:10.876186 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-acb09aba-8ca1-449d-96de-287ffdb80649 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.074296 Jan 18 20:17:10.876678 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 29/56] 10.222.0.67 () {64 vars in 1235 bytes} [Tue Jan 18 20:17:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:17:12.156936 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-db89e921-45b4-4191-b6ae-ad9767756073 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:12.157974 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-db89e921-45b4-4191-b6ae-ad9767756073 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jan 18 20:17:12.158968 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 28/57] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Jan 18 20:17:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:17:12.354049 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-91fa44e5-1aa2-4300-aa10-2577be562d38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:17:12.373533 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-91fa44e5-1aa2-4300-aa10-2577be562d38 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071878 Jan 18 20:17:12.374020 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 30/58] 10.222.0.67 () {64 vars in 1235 bytes} [Tue Jan 18 20:17:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:17:13.638477 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-db89e921-45b4-4191-b6ae-ad9767756073 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:13.639520 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-db89e921-45b4-4191-b6ae-ad9767756073 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jan 18 20:17:13.639922 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 29/59] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Jan 18 20:17:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:17:13.835472 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-f8555ffc-1905-40a4-93d3-0f57f2b0be10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:17:13.853981 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-f8555ffc-1905-40a4-93d3-0f57f2b0be10 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070466 Jan 18 20:17:13.854663 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 31/60] 10.222.0.67 () {64 vars in 1235 bytes} [Tue Jan 18 20:17:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:17:15.125406 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-db89e921-45b4-4191-b6ae-ad9767756073 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:15.126421 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-db89e921-45b4-4191-b6ae-ad9767756073 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jan 18 20:17:15.126858 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 30/61] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Jan 18 20:17:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:17:15.321681 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-7c3636a8-d28a-4731-a1f5-274239cda8b1 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:17:15.340677 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-7c3636a8-d28a-4731-a1f5-274239cda8b1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071835 Jan 18 20:17:15.341519 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 32/62] 10.222.0.67 () {60 vars in 1202 bytes} [Tue Jan 18 20:17:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:18:01.446497 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-db89e921-45b4-4191-b6ae-ad9767756073 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:18:01.447567 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-db89e921-45b4-4191-b6ae-ad9767756073 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Jan 18 20:18:01.447969 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 31/63] 10.222.0.67 () {54 vars in 930 bytes} [Tue Jan 18 20:18:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:18:01.508903 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-b821ed40-6dad-45c6-98ad-36b0a2d12b51 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:18:01.528872 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-b821ed40-6dad-45c6-98ad-36b0a2d12b51 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075086 Jan 18 20:18:01.529411 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 33/64] 10.222.0.67 () {60 vars in 1291 bytes} [Tue Jan 18 20:18:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:18:01.552268 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-b13af289-ee86-4662-a1f4-40553da5551f admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:18:01.559999 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-b13af289-ee86-4662-a1f4-40553da5551f admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012174 Jan 18 20:18:01.560552 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 32/65] 10.222.0.67 () {60 vars in 1282 bytes} [Tue Jan 18 20:18:01 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:18:01.571910 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-2eed8e7c-44fb-4160-9d8d-c622b0eac594 admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:18:01.579532 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-2eed8e7c-44fb-4160-9d8d-c622b0eac594 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011052 Jan 18 20:18:01.580047 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 34/66] 10.222.0.67 () {60 vars in 1285 bytes} [Tue Jan 18 20:18:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:18:01.590986 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-94c94ddf-bf1e-4516-ade5-c5e34bda83a9 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:18:01.599068 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-94c94ddf-bf1e-4516-ade5-c5e34bda83a9 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011586 Jan 18 20:18:01.599595 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 33/67] 10.222.0.67 () {60 vars in 1285 bytes} [Tue Jan 18 20:18:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:18:01.610658 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-980a9f6b-ca58-422e-b11c-22ff596ab8fe admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:18:01.618787 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-980a9f6b-ca58-422e-b11c-22ff596ab8fe admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011605 Jan 18 20:18:01.619332 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 35/68] 10.222.0.67 () {60 vars in 1282 bytes} [Tue Jan 18 20:18:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:19:27.621781 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-c0d12505-2029-44b3-8231-c2af4622f476 tempest-verify_tempest_config-488051231 tempest-verify_tempest_config-488051231-project] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:19:27.624668 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-c0d12505-2029-44b3-8231-c2af4622f476 tempest-verify_tempest_config-488051231 tempest-verify_tempest_config-488051231-project] 10.222.0.67 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106830 Jan 18 20:19:27.625226 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 34/69] 10.222.0.67 () {58 vars in 1133 bytes} [Tue Jan 18 20:19:27 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:20:59.116864 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-980a9f6b-ca58-422e-b11c-22ff596ab8fe admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:20:59.117901 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-980a9f6b-ca58-422e-b11c-22ff596ab8fe admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jan 18 20:20:59.118442 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 36/70] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Jan 18 20:20:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:20:59.387200 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-e81a981a-880c-4bbc-97ef-60bc9bc6b299 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:20:59.388382 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:20:59.388382 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: warnings.warn(msg) Jan 18 20:20:59.389901 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-e81a981a-880c-4bbc-97ef-60bc9bc6b299 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:20:59.390370 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-e81a981a-880c-4bbc-97ef-60bc9bc6b299 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:20:59.391211 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-e81a981a-880c-4bbc-97ef-60bc9bc6b299 admin admin] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:20:59.391633 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-e81a981a-880c-4bbc-97ef-60bc9bc6b299 admin admin] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:20:59.428271 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-e81a981a-880c-4bbc-97ef-60bc9bc6b299 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.160476 Jan 18 20:20:59.428840 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 35/71] 10.222.0.67 () {60 vars in 1193 bytes} [Tue Jan 18 20:20:59 2022] GET /compute/v2.1/os-services => generated 794 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:21:00.708940 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-980a9f6b-ca58-422e-b11c-22ff596ab8fe admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:21:00.709945 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-980a9f6b-ca58-422e-b11c-22ff596ab8fe admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jan 18 20:21:00.710336 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 37/72] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Jan 18 20:21:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:21:00.908722 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-40b08ffe-0691-43e0-a2d0-1d20a458ebe9 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:21:00.909894 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:21:00.909894 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: warnings.warn(msg) Jan 18 20:21:00.912024 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-40b08ffe-0691-43e0-a2d0-1d20a458ebe9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:21:00.912497 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-40b08ffe-0691-43e0-a2d0-1d20a458ebe9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:21:00.913380 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-40b08ffe-0691-43e0-a2d0-1d20a458ebe9 admin admin] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:21:00.913771 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-40b08ffe-0691-43e0-a2d0-1d20a458ebe9 admin admin] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:21:00.933749 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-40b08ffe-0691-43e0-a2d0-1d20a458ebe9 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078570 Jan 18 20:21:00.934896 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 36/73] 10.222.0.67 () {60 vars in 1193 bytes} [Tue Jan 18 20:21:00 2022] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:21:12.654497 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-980a9f6b-ca58-422e-b11c-22ff596ab8fe admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:21:12.655552 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-980a9f6b-ca58-422e-b11c-22ff596ab8fe admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jan 18 20:21:12.655941 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 38/74] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Jan 18 20:21:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:21:12.850860 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-f9ee247e-18ad-49e1-98f3-ab82a86d280d admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:21:12.852059 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:21:12.852059 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: warnings.warn(msg) Jan 18 20:21:12.853618 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-f9ee247e-18ad-49e1-98f3-ab82a86d280d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:21:12.854062 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-f9ee247e-18ad-49e1-98f3-ab82a86d280d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:21:12.854864 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-f9ee247e-18ad-49e1-98f3-ab82a86d280d admin admin] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:21:12.855316 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-f9ee247e-18ad-49e1-98f3-ab82a86d280d admin admin] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:21:12.878920 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-f9ee247e-18ad-49e1-98f3-ab82a86d280d admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080285 Jan 18 20:21:12.879674 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 37/75] 10.222.0.67 () {60 vars in 1193 bytes} [Tue Jan 18 20:21:12 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:21:14.144810 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: DEBUG nova.api.openstack.wsgi [None req-980a9f6b-ca58-422e-b11c-22ff596ab8fe admin admin] Calling method '>' {{(pid=101918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:21:14.145826 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: INFO nova.api.openstack.requestlog [None req-980a9f6b-ca58-422e-b11c-22ff596ab8fe admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jan 18 20:21:14.146227 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: [pid: 101918|app: 0|req: 39/76] 10.222.0.67 () {56 vars in 1074 bytes} [Tue Jan 18 20:21:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:21:14.341678 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG nova.api.openstack.wsgi [None req-04e4f1ae-be55-47b8-a764-823a3c401eb7 admin admin] Calling method '>' {{(pid=101919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:21:14.343098 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:21:14.343098 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: warnings.warn(msg) Jan 18 20:21:14.345143 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-04e4f1ae-be55-47b8-a764-823a3c401eb7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:21:14.345614 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-04e4f1ae-be55-47b8-a764-823a3c401eb7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:21:14.346487 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-04e4f1ae-be55-47b8-a764-823a3c401eb7 admin admin] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:21:14.346919 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: DEBUG oslo_concurrency.lockutils [None req-04e4f1ae-be55-47b8-a764-823a3c401eb7 admin admin] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:21:14.369021 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: INFO nova.api.openstack.requestlog [None req-04e4f1ae-be55-47b8-a764-823a3c401eb7 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079287 Jan 18 20:21:14.369517 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: [pid: 101919|app: 0|req: 38/77] 10.222.0.67 () {60 vars in 1193 bytes} [Tue Jan 18 20:21:14 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:22:13.376787 dv-cinder-821602-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 18 20:22:13.377889 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: Tue Jan 18 20:22:13 2022 - graceful shutdown triggered... Jan 18 20:22:13.378583 dv-cinder-821602-14-iscsi devstack@n-api.service[101918]: Gracefully killing worker 1 (pid: 101918)... Jan 18 20:22:13.379225 dv-cinder-821602-14-iscsi devstack@n-api.service[101919]: Gracefully killing worker 2 (pid: 101919)... Jan 18 20:22:14.379054 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: worker 1 buried after 1 seconds Jan 18 20:22:14.379635 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: worker 2 buried after 1 seconds Jan 18 20:22:14.379635 dv-cinder-821602-14-iscsi devstack@n-api.service[101917]: goodbye to uWSGI. Jan 18 20:22:14.380679 dv-cinder-821602-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 18 20:22:14.381234 dv-cinder-821602-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 18 20:22:14.384737 dv-cinder-821602-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 18 20:22:14.394404 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 18 20:22:14.396605 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jan 18 20:22:14 2022] *** Jan 18 20:22:14.396605 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 18 20:22:14.396605 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 18 20:22:14.396605 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: nodename: dv-cinder-821602-14-iscsi Jan 18 20:22:14.396605 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: machine: x86_64 Jan 18 20:22:14.396605 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: clock source: unix Jan 18 20:22:14.396605 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: pcre jit disabled Jan 18 20:22:14.396605 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: detected number of CPU cores: 4 Jan 18 20:22:14.396605 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: current working directory: / Jan 18 20:22:14.396605 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: detected binary path: /usr/bin/uwsgi-core Jan 18 20:22:14.396605 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: your processes number limit is 47680 Jan 18 20:22:14.396605 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: your memory page size is 4096 bytes Jan 18 20:22:14.396605 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: detected max file descriptor number: 2048 Jan 18 20:22:14.396605 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: lock engine: pthread robust mutexes Jan 18 20:22:14.398137 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: thunder lock: enabled Jan 18 20:22:14.398137 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 18 20:22:14.398137 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 18 20:22:14.444356 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: Python main interpreter initialized at 0x55d8df0b39c0 Jan 18 20:22:14.444356 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: python threads support enabled Jan 18 20:22:14.444356 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: your server socket listen backlog is limited to 100 connections Jan 18 20:22:14.444356 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: your mercy for graceful operations on workers is 90 seconds Jan 18 20:22:14.444947 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: mapped 403077 bytes (393 KB) for 2 cores Jan 18 20:22:14.444947 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: *** Operational MODE: preforking *** Jan 18 20:22:14.445195 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: *** uWSGI is running in multiple interpreter mode *** Jan 18 20:22:14.445195 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: spawned uWSGI master process (pid: 116359) Jan 18 20:22:14.445349 dv-cinder-821602-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 18 20:22:14.446382 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: spawned uWSGI worker 1 (pid: 116375, cores: 1) Jan 18 20:22:14.447124 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: spawned uWSGI worker 2 (pid: 116376, cores: 1) Jan 18 20:22:14.447502 dv-cinder-821602-14-iscsi devstack@n-api.service[116359]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 18 20:22:16.438475 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 18 20:22:16.438475 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: from cryptography.utils import int_from_bytes Jan 18 20:22:16.439314 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 18 20:22:16.439314 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: from cryptography.utils import int_from_bytes Jan 18 20:22:16.439862 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 18 20:22:16.439862 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: from cryptography.utils import int_from_bytes Jan 18 20:22:16.440026 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 18 20:22:16.440026 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: from cryptography.utils import int_from_bytes Jan 18 20:22:18.857442 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 18 20:22:18.857953 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 18 20:22:18.858227 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 18 20:22:18.858605 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 18 20:22:18.859021 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 18 20:22:18.859293 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.859626 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.859957 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.860284 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.860621 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.860941 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.861268 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.861597 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.861933 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.862200 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.862522 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.862862 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821602-14-iscsi {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.863219 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.863538 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.863860 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.864188 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.864501 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.864830 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.865143 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.865656 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.866112 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.866428 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.866751 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.867126 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.867492 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.867816 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.868201 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.868469 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.868809 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.869126 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.869501 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 18 20:22:18.869973 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821602-14-iscsi {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.870074 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 18 20:22:18.870178 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.870178 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.870327 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 18 20:22:18.870483 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.870652 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 18 20:22:18.871084 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.871203 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 18 20:22:18.871280 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.871363 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.871569 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.871670 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.871904 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.872029 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.872237 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.872344 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.872565 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.872680 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.872915 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.873028 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.873248 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.873357 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.873578 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.873696 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.873909 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.874021 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.874177 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.874286 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.874506 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.874617 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.874833 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.874932 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821602-14-iscsi {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.875196 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.879272 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.879406 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.879495 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.879574 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.879655 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.879725 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.879793 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.879870 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.879950 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.880024 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.880098 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.880184 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.880260 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.880349 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.880349 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.880493 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.880587 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.880669 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.880747 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.880822 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.880897 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.880972 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.881041 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.881116 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.881197 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.881266 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.881342 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.881416 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.881494 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.881573 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.881659 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.881734 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.881813 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.881888 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.881979 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.882056 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.882131 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.882200 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821602-14-iscsi {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.882267 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.882340 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.882430 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.882505 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.882583 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.882583 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.882722 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.882791 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.882874 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.882943 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.883017 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.883837 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.883984 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.884142 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.884296 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.884448 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.884602 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.884742 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.884893 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.885042 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.885182 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.885321 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.885460 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.885610 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.885778 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.886020 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.886179 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.886320 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.886459 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.886599 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.886746 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.886904 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.887102 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.887263 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.887405 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.887555 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.887707 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.887858 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.888024 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.888168 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.888316 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.888466 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.888615 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.888776 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.888946 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.889113 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.889254 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.889407 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.889560 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.889715 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.889865 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.890015 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.890155 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.890309 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.890457 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.890605 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.890746 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.890893 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.891066 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.891227 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.891379 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.892255 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.892409 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.892557 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.892713 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.892861 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.893004 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.893141 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.893280 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.893424 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.893577 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.893725 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.893881 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.894032 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.894201 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.894350 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.894501 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.894651 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.894800 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.894950 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.895214 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.895367 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.895525 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.895671 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.895671 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.895962 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.895962 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.896260 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.896401 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.896555 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.896706 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.896847 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.896847 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.897111 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.897249 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.897394 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.897542 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.897681 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.897831 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.897990 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.898139 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.898287 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.898945 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.899200 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.899348 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.899488 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.899640 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.899781 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.899928 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.900079 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.900231 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.900380 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.900531 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.900690 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.900839 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.900999 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.901290 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.901437 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.901584 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.902274 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.902545 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.902699 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.902848 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.903000 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.903218 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.903387 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.903537 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.903679 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.903825 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.903966 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.904105 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.904262 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.904403 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.904549 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.904695 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.904836 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.904974 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.905129 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.905287 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.905429 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.905569 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.905716 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.905869 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.906009 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.906148 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.906297 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.906297 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.906572 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.906722 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.906870 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.907046 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.907194 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.907345 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.907493 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.907648 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.907790 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.907942 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.908090 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.908244 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.908384 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.908523 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.908673 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.908828 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.908986 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.909138 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.909279 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.909418 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.909563 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.909716 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.909865 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.910013 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.910184 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.910349 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.910498 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.910656 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.910907 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.911106 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.911274 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.911520 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.911680 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.911897 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.912540 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.912821 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.912981 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.913134 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.913285 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.913489 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.913631 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.913798 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.913941 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.914088 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.914842 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.914986 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.915229 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.915385 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.915533 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.915689 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.915830 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.915978 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.916118 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.916257 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.916407 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.916556 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.916703 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.916844 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.916983 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.917129 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.917283 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.917283 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.917283 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.917283 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.917283 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.917283 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.917283 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.917283 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.918413 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.918413 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.918413 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.918819 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.918968 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.918968 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.919305 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.919448 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.919588 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 20:22:18.919735 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.919875 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.920255 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.920412 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.920573 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.920573 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.925800 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.925958 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.925958 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.926267 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.926409 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.926409 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.926690 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.926840 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.926996 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.927248 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.927248 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.927531 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.927679 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.927830 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.927979 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.928121 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.928482 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.928633 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.928785 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.928935 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.929084 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.929233 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.929394 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.929394 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.929664 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.929818 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.929818 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.930085 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.930234 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.930374 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.930521 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.930677 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.930831 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.930972 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.931353 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.931505 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.931646 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.931797 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.931945 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.932086 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.932235 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.932375 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.932528 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.932690 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.932833 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.932833 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.933104 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.933268 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.933268 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.933543 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.933682 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.933682 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.933955 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.934106 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.934106 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.934390 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.934530 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.934530 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.935690 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.935992 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.935992 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.936300 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.936451 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.936600 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.936748 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.936899 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.937050 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.937199 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.937340 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.937340 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.937616 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.938026 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.938026 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.938326 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.938467 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.938467 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.938753 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.938903 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.938903 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.939199 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.939350 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.939350 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.939625 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.939845 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.940002 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.940173 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.940328 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.940470 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.940618 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.940766 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.940915 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.941063 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.941209 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.941358 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.941551 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.941694 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.941842 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.941982 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.942338 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.942489 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.942644 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.942786 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.942932 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.943099 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.943258 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.943399 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.943553 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.943703 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.943852 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.944003 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.944192 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.944355 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.944517 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.944665 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.944813 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.945896 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.946213 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.946373 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.946516 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.946668 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.946668 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.946936 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.947115 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.947276 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.947431 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.947580 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.947727 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.947875 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.948022 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.948172 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.948313 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.948453 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.948593 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.948739 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.948880 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.949028 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.949176 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.949326 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.949466 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.949606 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.949826 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.949978 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.950194 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.950338 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.950478 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.950618 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.950767 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.950916 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.951077 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.951517 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.951661 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.951801 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.951954 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.952102 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.952243 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.952384 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.952535 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.952684 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.952838 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.952994 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.953149 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.953413 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.953573 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.953725 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.953867 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.954014 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.954161 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.954309 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.954450 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.954750 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.954945 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.955189 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.955963 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.956119 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.956260 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.956442 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.956793 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.956943 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.957083 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.957223 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.957363 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.957519 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.957660 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.957800 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.957941 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.958088 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.958307 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.958451 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.958603 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.958786 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.958943 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.959196 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.959357 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.959507 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.959716 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.959970 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.960230 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.960230 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.960548 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.960734 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.961452 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.961666 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.961832 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.961988 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.962146 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.962293 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.962448 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.962594 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.962750 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.962918 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.963102 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.963257 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.963404 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.963561 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.963709 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.963867 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.964021 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.964199 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.964351 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.964497 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.964652 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.964807 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.964953 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.965108 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.965257 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.965401 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.966201 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.966370 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.966527 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.966675 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.966839 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.967183 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.967350 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.967511 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.967670 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.967817 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.967970 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.968130 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.968291 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.968452 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.968600 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.968744 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.968889 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.969042 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.969197 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.969352 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.969506 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.969506 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.969794 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.969939 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.970099 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.970321 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.970485 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.970634 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.970779 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.970946 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.971190 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.971343 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.971497 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.971647 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.971859 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.972024 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.972208 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.972361 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.972527 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.972683 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.972829 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.972996 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.973144 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.973290 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.973434 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.973580 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.973726 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.973885 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.974048 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.974208 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.974365 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.974522 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.974670 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.974824 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.974978 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.975150 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.975308 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.975463 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.975623 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.976316 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.976485 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.977317 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.977599 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.977754 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.977927 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.978077 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.978232 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.978380 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.978534 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.978690 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.978845 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.979001 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.979191 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.979364 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.979523 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.979677 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.979830 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.979998 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.980163 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.980343 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.980536 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.980686 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.980833 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.980987 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.981158 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.981376 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.981527 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.981675 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.981879 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.982122 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.982353 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.982599 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.982840 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.983094 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.983257 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.983406 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.983567 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.983726 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.983875 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.984022 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.984221 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.984435 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.984619 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.984768 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.984923 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.985071 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.985227 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.985382 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.985544 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.985693 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.985841 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.986676 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.986842 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.986991 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.987177 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.987177 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.987560 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.987873 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.988028 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.988214 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.988369 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.988524 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.988681 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.988829 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.988976 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.989131 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.989304 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.989549 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.989816 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.989981 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.990195 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.990382 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.990581 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.990783 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.990935 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.991147 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.991313 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.991612 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.991779 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.991935 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.992109 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.992328 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.992488 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.992645 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.992792 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.992945 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.993095 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.993241 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.993395 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.993544 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.993698 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.993846 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.994000 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.994165 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.994328 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.994489 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.994489 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.994771 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.994926 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.995177 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.995343 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.995500 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.995656 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.995656 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.995944 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.996100 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.996922 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.997090 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.997247 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.997394 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.997541 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.997697 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.997872 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.998166 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.998320 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.998466 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.998612 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.998766 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.998928 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.999147 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.999301 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.999447 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.999593 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.999751 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:18.999904 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.000051 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.000223 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.000380 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.000536 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.000714 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.000899 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.001057 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.001214 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.001361 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.001522 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.001734 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.001904 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.002052 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.002199 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.002343 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.002499 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.002654 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.002816 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.002983 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.003175 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.003325 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.003480 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.003627 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.003773 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.003932 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.004088 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.004251 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.004398 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.004552 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.004761 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.004931 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.005080 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.005237 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.005393 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.005547 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.005695 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.005854 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.006009 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.006165 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.006320 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.006777 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.007288 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.007447 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.007594 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.007750 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.008680 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.008837 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.008994 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.009150 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.009150 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.009440 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.009440 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.009718 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.009873 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.010032 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.010238 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.010404 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.010569 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.010778 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.010943 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.011113 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.011265 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.011423 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.011571 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.011716 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.011922 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.012074 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.012235 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.012383 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.012530 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.012695 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.012843 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.012988 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.013134 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.013280 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.013443 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.013611 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.013611 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.013966 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.014116 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.014263 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.014409 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.014566 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.014732 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.014888 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.015088 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.015244 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.015391 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.015549 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.015698 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.015844 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.015990 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.016135 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.016290 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.016437 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.016609 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.017358 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.017525 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.017683 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.017845 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.018001 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.018198 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.018352 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.018499 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.018793 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.018962 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.019164 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.019164 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.019468 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.019625 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.019782 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.020006 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.020164 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.020320 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.020467 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.020612 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.020771 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.020921 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.021067 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.021213 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.021359 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.021523 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.021685 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.021840 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.021989 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.022136 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.022281 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.022435 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.022654 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.022811 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.022959 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.023141 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.023298 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.023521 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.024205 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.024363 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.024518 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.024666 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.024812 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.024966 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.025119 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.025265 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.026043 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.026208 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.026431 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.026596 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.026745 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.026925 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.027748 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.027911 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.028066 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.028225 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.028381 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.028530 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.028683 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.028970 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.029125 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.029283 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.029431 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.029588 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.029742 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.029897 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.030055 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.030203 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.030349 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.030502 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.030648 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.030795 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.030954 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.031148 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.031309 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.031464 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.031629 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.031777 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.031936 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.032091 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.032237 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.032448 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.032597 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.032742 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.032897 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.033044 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.033189 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.033346 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.033493 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.033659 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.033813 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.033960 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.033960 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.034238 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.034238 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.034525 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.034672 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.034817 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.034963 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.035143 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.035143 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.035447 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.035606 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.035753 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.035900 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.036047 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.036192 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.036347 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.036501 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.036648 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.036794 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.036939 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.037116 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.037363 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.037968 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.038122 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.038282 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.038437 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.038591 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.038740 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.038740 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.039249 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.039419 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.039575 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.039737 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.039894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.040042 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.040199 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.040345 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.040491 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.040651 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.040807 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.040954 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.041107 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.041253 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.041414 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.041569 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.041717 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.041864 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.042009 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.042172 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.042334 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.042489 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.042644 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.042799 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.042799 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.043111 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.043111 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.043424 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.043570 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.043716 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.043716 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.044017 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.044188 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.044343 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.044489 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.044634 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.044779 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.044941 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.045089 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.045234 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.045386 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.045540 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.045693 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.045848 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.046014 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.046162 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.046314 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.046461 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.046607 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.046763 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.046911 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.047165 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.047416 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.048111 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.048269 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.048415 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.048561 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.048727 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.048880 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.048880 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.049189 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.049465 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.049627 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.049782 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.049931 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.050086 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.050507 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.050663 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.050818 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.050967 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.051234 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.051410 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.051559 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.051714 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.051862 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.052017 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.052180 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.052337 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.052337 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.052617 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.052764 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.052917 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.053078 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.053253 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.053414 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.053667 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.053839 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.053989 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.054151 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.054300 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.054447 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.054601 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.054802 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.055110 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.055294 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.055466 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.055615 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.055762 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.055908 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.056063 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.056210 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.056356 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.056512 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.056661 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.056807 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.056962 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.057109 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.057255 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.057433 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.057591 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.058312 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.058479 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.058638 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.058787 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.058945 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.059125 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.059296 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.059472 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.059637 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.059909 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.060062 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.060220 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.060376 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.060376 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.060667 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.060821 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.060976 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.061131 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.061298 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.061447 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.061600 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.061748 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.061903 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.062060 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.062225 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.062381 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.062537 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.062537 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.062830 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.062984 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.063155 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.063155 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.063443 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.063443 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.063742 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.063742 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.063742 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.063742 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.063742 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.064497 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.064652 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.064814 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.064963 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.065110 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.065267 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.065414 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.065575 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.065723 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.065899 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.066049 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.066196 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.066349 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.066504 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.066663 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.066810 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.066965 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.067177 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.067329 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.067488 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.067644 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.067801 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.068447 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.068604 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.068769 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.068918 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.069066 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.069213 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.069213 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.069499 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.069658 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.072966 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.073166 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.073330 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.073497 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.073651 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.073827 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.073827 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.074116 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.074272 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.074431 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.074592 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.074742 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.074890 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.075074 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.075240 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.075402 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.075559 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.075707 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.075854 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.076000 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.076000 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.076279 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.076440 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.076588 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.076735 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.076889 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.077044 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.077192 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.077368 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.077525 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.077681 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.077827 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.077974 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.078620 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.078788 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.078946 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.079116 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.079266 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.079424 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.079588 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.079744 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.079903 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.080052 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.080207 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.080355 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.080511 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.080667 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.080815 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.080961 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.081115 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.081263 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.081493 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.081653 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.081808 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.081968 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.082115 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.082275 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.082275 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.082566 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.082566 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.082854 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.083315 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.083502 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.083660 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.083821 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.083977 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.084150 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.084303 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.084303 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.084619 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.084777 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.084934 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.085082 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.085238 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.085404 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.086657 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.086831 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.086983 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.087230 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.087406 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.087563 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.087712 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.087867 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.088016 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.088163 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.088843 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.089012 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.089170 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.089326 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.089482 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.089630 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.089787 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.089947 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.090103 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.090259 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.090414 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.090571 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.090718 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.090865 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.090865 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.091207 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.091360 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.091523 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.091672 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.091830 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.091977 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.091977 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.092334 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.092500 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.092658 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.092814 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.092962 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.093109 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.093256 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.093417 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.093566 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.093847 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.094012 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.094159 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.094316 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.094464 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.094464 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.094749 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.094905 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.095093 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.095269 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.095419 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.095579 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.095727 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.095881 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.096047 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.096223 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.096382 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.096530 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.096676 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.096823 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.096992 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.097142 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.097288 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.097444 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.097592 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.097766 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.097925 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.098073 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.098227 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.098375 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.099091 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.099091 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.099408 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.099559 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.099713 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.099861 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.100008 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.100169 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.100330 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.100485 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.100641 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.100789 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.100934 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.101089 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.101248 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.101403 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.101581 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.101737 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.101893 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.102050 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.102215 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.102215 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.102505 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.102653 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.102808 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.102956 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.103135 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.103286 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.103440 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.103440 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.103779 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.104695 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.104861 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.104861 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.105163 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.105312 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.105312 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.105597 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.105755 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.105911 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.106066 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.106221 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.106369 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.106515 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.106682 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.107134 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.107306 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.107465 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.107621 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.107770 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.107927 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.108076 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.108240 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.108389 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.108537 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.109379 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.109550 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.109716 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.109871 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.110019 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.110165 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.110327 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.110475 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.110622 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.110768 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.110914 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.111099 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.111839 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.112046 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.112212 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.112359 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.112514 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.112663 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.112825 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.112974 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.113123 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.113282 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.113431 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.113592 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.113763 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.113924 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.114109 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.114404 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.114566 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.114727 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.114882 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.115059 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.115215 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.115362 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.115521 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.115684 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.115684 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.115975 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.116121 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.116287 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.116444 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.116601 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.116750 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.116905 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.117061 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.117249 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.117489 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.117656 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.117813 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.117963 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.118118 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.118305 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.118485 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.118880 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.119545 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.119707 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.119855 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.120022 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.120181 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.120331 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.120479 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.121087 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.121360 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.121531 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.121701 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.121857 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.122018 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.122176 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.122332 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.122494 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.122655 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.122804 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.122951 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.123123 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.123273 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.123434 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.123584 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.123755 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.123915 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.124075 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.124230 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.124407 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.124697 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.124853 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.125000 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.125156 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.125319 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.125470 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.125624 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.125781 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.125954 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.126105 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.126333 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.126495 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.126648 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.126803 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.126951 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.127120 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.127287 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.127444 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.127592 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.127748 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.127915 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.127915 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.128112 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.128249 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.128378 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.128518 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.128659 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.128803 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.128803 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.129063 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.129192 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.129710 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.129850 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.130115 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.130208 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.130300 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.130392 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.130484 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.130576 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.130670 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.130761 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.130855 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.130941 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131013 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131182 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131257 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131327 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 18 20:22:19.131406 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131406 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131406 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131406 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131406 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131406 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131406 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131406 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.131894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.132396 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.132396 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.132396 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.132396 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.132396 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.132396 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.132396 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.132396 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.133439 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.133439 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.133439 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.133439 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.133439 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.133439 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.133439 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.133439 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.133938 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.133938 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.133938 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.133938 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.133938 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.133938 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.133938 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.133938 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.134434 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.134434 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.134434 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.134434 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.134434 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.134434 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.134434 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.134434 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.134954 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.134954 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.134954 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.134954 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.134954 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.134954 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.134954 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.134954 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.135481 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.135481 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.135481 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.135481 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.135481 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.135481 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.135481 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.135481 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.135942 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.135942 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.135942 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.135942 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.135942 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.135942 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.135942 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.135942 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.136496 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.136496 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.136496 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.136496 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.136496 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.136867 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_db.sqlalchemy.engines [None req-cc5abaf5-2730-4d10-a51c-238f41fb921f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116376) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 20:22:19.136955 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.136955 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.136955 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.137331 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.137875 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.138289 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.138705 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.139134 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 20:22:19.139485 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 18 20:22:19.164342 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_db.sqlalchemy.engines [None req-ef7a0060-4ec3-4bb0-9056-97f804c6378c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 20:22:19.209819 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.context [None req-cc5abaf5-2730-4d10-a51c-238f41fb921f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f3f10cc4-091c-4f8e-95bd-0bc3374e1059(cell1) {{(pid=116376) load_cells /opt/stack/nova/nova/context.py:464}} Jan 18 20:22:19.214787 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cc5abaf5-2730-4d10-a51c-238f41fb921f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:22:19.216425 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cc5abaf5-2730-4d10-a51c-238f41fb921f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:22:19.217270 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cc5abaf5-2730-4d10-a51c-238f41fb921f None None] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:22:19.219260 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cc5abaf5-2730-4d10-a51c-238f41fb921f None None] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:22:19.230473 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_db.sqlalchemy.engines [None req-cc5abaf5-2730-4d10-a51c-238f41fb921f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116376) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 20:22:19.232057 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_db.sqlalchemy.engines [None req-cc5abaf5-2730-4d10-a51c-238f41fb921f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116376) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 20:22:19.232939 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.context [None req-ef7a0060-4ec3-4bb0-9056-97f804c6378c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f3f10cc4-091c-4f8e-95bd-0bc3374e1059(cell1) {{(pid=116375) load_cells /opt/stack/nova/nova/context.py:464}} Jan 18 20:22:19.237529 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ef7a0060-4ec3-4bb0-9056-97f804c6378c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:22:19.239193 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ef7a0060-4ec3-4bb0-9056-97f804c6378c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:22:19.240071 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ef7a0060-4ec3-4bb0-9056-97f804c6378c None None] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:22:19.242071 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ef7a0060-4ec3-4bb0-9056-97f804c6378c None None] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:22:19.253016 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_db.sqlalchemy.engines [None req-ef7a0060-4ec3-4bb0-9056-97f804c6378c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 20:22:19.254216 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_db.sqlalchemy.engines [None req-ef7a0060-4ec3-4bb0-9056-97f804c6378c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 20:22:19.402803 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_db.sqlalchemy.engines [None req-cc5abaf5-2730-4d10-a51c-238f41fb921f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116376) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 20:22:19.424232 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_db.sqlalchemy.engines [None req-ef7a0060-4ec3-4bb0-9056-97f804c6378c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 18 20:22:19.747341 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: WARNING keystonemiddleware.auth_token [None req-cc5abaf5-2730-4d10-a51c-238f41fb921f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 18 20:22:19.753961 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: WARNING keystonemiddleware.auth_token [None req-cc5abaf5-2730-4d10-a51c-238f41fb921f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 18 20:22:19.760248 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: WARNING keystonemiddleware.auth_token [None req-ef7a0060-4ec3-4bb0-9056-97f804c6378c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 18 20:22:19.766815 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: WARNING keystonemiddleware.auth_token [None req-ef7a0060-4ec3-4bb0-9056-97f804c6378c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 18 20:22:20.107367 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: WARNING keystonemiddleware.auth_token [None req-cc5abaf5-2730-4d10-a51c-238f41fb921f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 18 20:22:20.111398 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: WARNING keystonemiddleware.auth_token [None req-ef7a0060-4ec3-4bb0-9056-97f804c6378c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 18 20:22:20.112632 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: WARNING keystonemiddleware.auth_token [None req-cc5abaf5-2730-4d10-a51c-238f41fb921f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 18 20:22:20.116850 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: WARNING keystonemiddleware.auth_token [None req-ef7a0060-4ec3-4bb0-9056-97f804c6378c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 18 20:22:20.118867 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d8df0b39c0 pid: 116376 (default app) Jan 18 20:22:20.122714 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d8df0b39c0 pid: 116375 (default app) Jan 18 20:22:59.966223 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ca12b7a0-08d5-41d5-a47b-7311356ac2a0 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Action: 'create', calling method: .version_select at 0x7f1788d5ddc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1761030929"}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:00.043629 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2e7bf2b7-418e-4076-ae77-e2f4edf6f282 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-452821363", "imageRef": "c7d259ac-b206-430f-a3c0-794cee408236", "flavorRef": "452", "networks": [{"uuid": "2d9683a0-21df-40c1-a588-afe062762ffa"}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:00.975174 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-2e7bf2b7-418e-4076-ae77-e2f4edf6f282 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] validate_networks() for [('2d9683a0-21df-40c1-a588-afe062762ffa', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:23:01.808971 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ca12b7a0-08d5-41d5-a47b-7311356ac2a0 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.647784 Jan 18 20:23:01.809798 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 1/1] 10.222.0.67 () {60 vars in 1154 bytes} [Tue Jan 18 20:22:58 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3654 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 18 20:23:02.295237 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-cb1b2374-93de-46fb-a1d7-5526dd077be6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1144842869", "imageRef": "c7d259ac-b206-430f-a3c0-794cee408236", "flavorRef": "452", "networks": [{"uuid": "dcb439eb-a130-48e2-8bcd-35ade9b8c9da"}]}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:02.496789 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.network.neutron [None req-cb1b2374-93de-46fb-a1d7-5526dd077be6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] validate_networks() for [('dcb439eb-a130-48e2-8bcd-35ade9b8c9da', None, None, None, None, None)] {{(pid=116376) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:23:03.025984 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-2e7bf2b7-418e-4076-ae77-e2f4edf6f282 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:23:03.028076 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-2e7bf2b7-418e-4076-ae77-e2f4edf6f282 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:23:03.130946 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-2e7bf2b7-418e-4076-ae77-e2f4edf6f282 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:23:03.130946 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-2e7bf2b7-418e-4076-ae77-e2f4edf6f282 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:23:03.130946 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-2e7bf2b7-418e-4076-ae77-e2f4edf6f282 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:23:03.130946 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2e7bf2b7-418e-4076-ae77-e2f4edf6f282 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:03.166524 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2e7bf2b7-418e-4076-ae77-e2f4edf6f282 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:03.166524 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2e7bf2b7-418e-4076-ae77-e2f4edf6f282 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:03.166524 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2e7bf2b7-418e-4076-ae77-e2f4edf6f282 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:03.186071 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-2e7bf2b7-418e-4076-ae77-e2f4edf6f282 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Getting quotas for project 53df14bc8279467abba49fbed7498d26. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:23:03.209334 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-2e7bf2b7-418e-4076-ae77-e2f4edf6f282 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Getting quotas for user e208af39fae54cebb2a93c20b0f0d317 and project 53df14bc8279467abba49fbed7498d26. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:23:03.257296 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2e7bf2b7-418e-4076-ae77-e2f4edf6f282 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:23:03.261779 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2e7bf2b7-418e-4076-ae77-e2f4edf6f282 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7d259ac-b206-430f-a3c0-794cee408236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:23:03.466016 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2e7bf2b7-418e-4076-ae77-e2f4edf6f282 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.151629 Jan 18 20:23:03.476094 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 1/2] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:22:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 5156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 20:23:03.480568 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6823f1b7-e614-47ce-bb39-fe9ffffeb6bb tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] Calling method '.version_select at 0x7f1788bce700>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:03.746559 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6823f1b7-e614-47ce-bb39-fe9ffffeb6bb tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/988c818b-2d28-463d-a838-06e093f45002" status: 200 len: 350 microversion: 2.1 time: 0.277549 Jan 18 20:23:03.751496 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 2/3] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Jan 18 20:23:03 2022] GET /compute/v2.1/os-volumes/988c818b-2d28-463d-a838-06e093f45002 => generated 350 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:03.776847 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3494cc52-c955-408d-b5d9-2dca82d9863e tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Calling method '.version_select at 0x7f1788bceee0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:04.040370 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3494cc52-c955-408d-b5d9-2dca82d9863e tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/cdffcddb-d8ab-48aa-a26d-1cee1bad146a" status: 200 len: 346 microversion: 2.1 time: 0.286600 Jan 18 20:23:04.041855 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 3/4] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Jan 18 20:23:03 2022] GET /compute/v2.1/os-volumes/cdffcddb-d8ab-48aa-a26d-1cee1bad146a => generated 346 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:04.064044 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4ce2049a-a4c6-4846-a0b5-6d7440d1a46d tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:04.065421 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4ce2049a-a4c6-4846-a0b5-6d7440d1a46d tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:04.427638 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4ce2049a-a4c6-4846-a0b5-6d7440d1a46d tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:04.450561 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4ce2049a-a4c6-4846-a0b5-6d7440d1a46d tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1214 microversion: 2.1 time: 0.406693 Jan 18 20:23:04.451945 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 4/5] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:04 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1214 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:04.456996 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9a4816c7-7511-40d8-ad24-f043747b4616 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Action: 'create', calling method: .version_select at 0x7f1788bcee50>, body: {"snapshot": {"volume_id": "cdffcddb-d8ab-48aa-a26d-1cee1bad146a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1729563319"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:05.330145 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9a4816c7-7511-40d8-ad24-f043747b4616 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] 10.222.0.67 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.876748 Jan 18 20:23:05.341998 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 5/6] 10.222.0.67 () {60 vars in 1161 bytes} [Tue Jan 18 20:23:04 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:05.353271 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fb661e83-c4e7-41d3-98c4-e9d1eab880a8 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Calling method '.version_select at 0x7f17882f6e50>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:05.652299 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fb661e83-c4e7-41d3-98c4-e9d1eab880a8 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/75d1dbca-48cc-436f-9e7c-fff695088dfe" status: 200 len: 287 microversion: 2.1 time: 0.309102 Jan 18 20:23:05.653121 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 6/7] 10.222.0.67 () {58 vars in 1250 bytes} [Tue Jan 18 20:23:05 2022] GET /compute/v2.1/os-snapshots/75d1dbca-48cc-436f-9e7c-fff695088dfe => generated 287 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:05.659333 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-cae36b09-6ed5-4bc8-8d5b-e64b9ab6034c tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:05.660514 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-cae36b09-6ed5-4bc8-8d5b-e64b9ab6034c tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:05.821971 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-cae36b09-6ed5-4bc8-8d5b-e64b9ab6034c tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:05.829610 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-cae36b09-6ed5-4bc8-8d5b-e64b9ab6034c tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1214 microversion: 2.1 time: 0.175037 Jan 18 20:23:05.830221 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 7/8] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:05 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1214 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:05.837739 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-cfcaab52-ecb8-44a7-a561-4d75929607d5 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Calling method '.version_select at 0x7f178834ef70>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:05.952937 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-cfcaab52-ecb8-44a7-a561-4d75929607d5 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.121523 Jan 18 20:23:05.953710 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 8/9] 10.222.0.67 () {58 vars in 1139 bytes} [Tue Jan 18 20:23:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:05.968958 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-821f3fea-2e5c-4d0a-9e23-ef61e150548e tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Calling method '.version_select at 0x7f17882ec0d0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:06.010803 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-cb1b2374-93de-46fb-a1d7-5526dd077be6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Flavor limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:23:06.011655 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-cb1b2374-93de-46fb-a1d7-5526dd077be6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Image limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:23:06.011798 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-cb1b2374-93de-46fb-a1d7-5526dd077be6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Flavor pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:23:06.012305 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-cb1b2374-93de-46fb-a1d7-5526dd077be6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Image pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:23:06.012733 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-cb1b2374-93de-46fb-a1d7-5526dd077be6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:23:06.063617 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-821f3fea-2e5c-4d0a-9e23-ef61e150548e tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/75d1dbca-48cc-436f-9e7c-fff695088dfe" status: 200 len: 287 microversion: 2.1 time: 0.098881 Jan 18 20:23:06.064302 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 9/10] 10.222.0.67 () {58 vars in 1250 bytes} [Tue Jan 18 20:23:05 2022] GET /compute/v2.1/os-snapshots/75d1dbca-48cc-436f-9e7c-fff695088dfe => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:23:06.072446 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b1a68ca3-99f3-45ec-b468-a25bf51b6d1a tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] Calling method '.version_select at 0x7f17883075e0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:06.085602 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cb1b2374-93de-46fb-a1d7-5526dd077be6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:06.092640 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cb1b2374-93de-46fb-a1d7-5526dd077be6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:06.098359 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cb1b2374-93de-46fb-a1d7-5526dd077be6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:06.101646 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cb1b2374-93de-46fb-a1d7-5526dd077be6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:06.164908 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-cb1b2374-93de-46fb-a1d7-5526dd077be6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Getting quotas for project ac7d65640ff94651a7ef1d826ade4cfe. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:23:06.185929 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-cb1b2374-93de-46fb-a1d7-5526dd077be6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Getting quotas for user 6c8a95c08cbe4253b4c279403eeb2bb6 and project ac7d65640ff94651a7ef1d826ade4cfe. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:23:06.221403 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-cb1b2374-93de-46fb-a1d7-5526dd077be6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Going to run 1 instances... {{(pid=116376) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:23:06.231948 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-cb1b2374-93de-46fb-a1d7-5526dd077be6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7d259ac-b206-430f-a3c0-794cee408236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116376) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:23:06.325350 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b1a68ca3-99f3-45ec-b468-a25bf51b6d1a tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/e23fb83c-9053-4f78-a9c5-33725a59607e" status: 200 len: 351 microversion: 2.1 time: 0.259555 Jan 18 20:23:06.326252 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 10/11] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Jan 18 20:23:06 2022] GET /compute/v2.1/os-volumes/e23fb83c-9053-4f78-a9c5-33725a59607e => generated 351 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:06.395458 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-cb1b2374-93de-46fb-a1d7-5526dd077be6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.575806 Jan 18 20:23:06.406806 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 2/12] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:23:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 4596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 20:23:06.411429 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-127640f3-7af7-49ee-ad94-291385141239 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:06.412057 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-127640f3-7af7-49ee-ad94-291385141239 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:06.723805 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-127640f3-7af7-49ee-ad94-291385141239 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:06.749017 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-127640f3-7af7-49ee-ad94-291385141239 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1218 microversion: 2.1 time: 0.340960 Jan 18 20:23:06.764210 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 11/13] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:06 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1218 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:06.849363 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7c4df947-95a6-456a-99de-b1239fbf0ec6 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:06.850743 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-7c4df947-95a6-456a-99de-b1239fbf0ec6 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:06.908231 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7c4df947-95a6-456a-99de-b1239fbf0ec6 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:06.913968 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7c4df947-95a6-456a-99de-b1239fbf0ec6 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:06.914911 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7c4df947-95a6-456a-99de-b1239fbf0ec6 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:06.933349 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7c4df947-95a6-456a-99de-b1239fbf0ec6 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:07.078789 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4d279fa4-44a7-4a28-8a18-2c7832fdb008 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Calling method '.version_select at 0x7f1788bce700>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:07.234945 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4d279fa4-44a7-4a28-8a18-2c7832fdb008 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/75d1dbca-48cc-436f-9e7c-fff695088dfe" status: 200 len: 287 microversion: 2.1 time: 0.161343 Jan 18 20:23:07.241259 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 12/14] 10.222.0.67 () {58 vars in 1250 bytes} [Tue Jan 18 20:23:07 2022] GET /compute/v2.1/os-snapshots/75d1dbca-48cc-436f-9e7c-fff695088dfe => generated 287 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:23:07.282472 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-7c4df947-95a6-456a-99de-b1239fbf0ec6 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:07.331874 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7c4df947-95a6-456a-99de-b1239fbf0ec6 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1218 microversion: 2.1 time: 0.486677 Jan 18 20:23:07.334173 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 3/15] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:06 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1218 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:07.769146 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4f573725-33c3-41f1-9eb0-8f56adbe2de0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:07.769839 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4f573725-33c3-41f1-9eb0-8f56adbe2de0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:07.928899 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4f573725-33c3-41f1-9eb0-8f56adbe2de0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:07.948527 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4f573725-33c3-41f1-9eb0-8f56adbe2de0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1218 microversion: 2.1 time: 0.183768 Jan 18 20:23:07.953840 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 13/16] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:07 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1218 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:08.250056 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-c8712ac1-a9ab-46e1-945a-57f2df7a1900 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Calling method '.version_select at 0x7f1788256820>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:08.360830 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bc8fdcb0-367c-47f3-81f4-10a82ffa8422 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:08.361999 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bc8fdcb0-367c-47f3-81f4-10a82ffa8422 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:08.372835 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-c8712ac1-a9ab-46e1-945a-57f2df7a1900 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/75d1dbca-48cc-436f-9e7c-fff695088dfe" status: 200 len: 287 microversion: 2.1 time: 0.126364 Jan 18 20:23:08.379604 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 4/17] 10.222.0.67 () {58 vars in 1250 bytes} [Tue Jan 18 20:23:08 2022] GET /compute/v2.1/os-snapshots/75d1dbca-48cc-436f-9e7c-fff695088dfe => generated 287 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:08.400594 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bc8fdcb0-367c-47f3-81f4-10a82ffa8422 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:08.401833 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bc8fdcb0-367c-47f3-81f4-10a82ffa8422 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:08.409799 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bc8fdcb0-367c-47f3-81f4-10a82ffa8422 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:08.410922 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bc8fdcb0-367c-47f3-81f4-10a82ffa8422 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:08.984816 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a138e2d3-2f26-44ca-b6b4-94deadf476e6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:09.000471 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-a138e2d3-2f26-44ca-b6b4-94deadf476e6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:09.025785 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a138e2d3-2f26-44ca-b6b4-94deadf476e6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:09.046186 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a138e2d3-2f26-44ca-b6b4-94deadf476e6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:09.055850 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a138e2d3-2f26-44ca-b6b4-94deadf476e6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:09.062648 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a138e2d3-2f26-44ca-b6b4-94deadf476e6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:09.278039 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bc8fdcb0-367c-47f3-81f4-10a82ffa8422 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:09.345188 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a138e2d3-2f26-44ca-b6b4-94deadf476e6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:09.361648 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a138e2d3-2f26-44ca-b6b4-94deadf476e6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1214 microversion: 2.1 time: 0.384173 Jan 18 20:23:09.367268 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 5/18] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:08 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1214 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:09.372559 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fa763f0b-6a68-45bd-bf7d-c81710aecdd1 tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] Calling method '.version_select at 0x7f1788289e50>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:09.377399 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bc8fdcb0-367c-47f3-81f4-10a82ffa8422 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1218 microversion: 2.1 time: 1.017936 Jan 18 20:23:09.388560 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 14/19] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:08 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1218 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:09.404865 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5836505f-9157-4232-bc22-8e7fd6db788d tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Calling method '.version_select at 0x7f178821a310>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:09.519844 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5836505f-9157-4232-bc22-8e7fd6db788d tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/75d1dbca-48cc-436f-9e7c-fff695088dfe" status: 200 len: 288 microversion: 2.1 time: 0.128752 Jan 18 20:23:09.521076 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 15/20] 10.222.0.67 () {58 vars in 1250 bytes} [Tue Jan 18 20:23:09 2022] GET /compute/v2.1/os-snapshots/75d1dbca-48cc-436f-9e7c-fff695088dfe => generated 288 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:23:09.545314 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bdd3f857-2f29-406d-9780-e4edea406018 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Calling method '.version_select at 0x7f1788227280>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:09.564775 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-fa763f0b-6a68-45bd-bf7d-c81710aecdd1 tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/4abfe709-537e-417c-afba-41a07fc6368e" status: 200 len: 351 microversion: 2.1 time: 0.195408 Jan 18 20:23:09.565713 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 6/21] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Jan 18 20:23:09 2022] GET /compute/v2.1/os-volumes/4abfe709-537e-417c-afba-41a07fc6368e => generated 351 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:09.595440 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7e8d14e4-19f1-4382-a8ac-7082eec115e4 tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] Calling method '.version_select at 0x7f17882563a0>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:09.743646 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bdd3f857-2f29-406d-9780-e4edea406018 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] 10.222.0.67 "DELETE /compute/v2.1/os-snapshots/75d1dbca-48cc-436f-9e7c-fff695088dfe" status: 202 len: 0 microversion: 2.1 time: 0.213510 Jan 18 20:23:09.744446 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 16/22] 10.222.0.67 () {58 vars in 1253 bytes} [Tue Jan 18 20:23:09 2022] DELETE /compute/v2.1/os-snapshots/75d1dbca-48cc-436f-9e7c-fff695088dfe => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:23:09.757309 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3387d8a3-8fb7-4d06-a274-959782c23526 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Calling method '.version_select at 0x7f17882279d0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:09.822880 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3387d8a3-8fb7-4d06-a274-959782c23526 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/75d1dbca-48cc-436f-9e7c-fff695088dfe" status: 200 len: 287 microversion: 2.1 time: 0.073555 Jan 18 20:23:09.823509 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 17/23] 10.222.0.67 () {58 vars in 1250 bytes} [Tue Jan 18 20:23:09 2022] GET /compute/v2.1/os-snapshots/75d1dbca-48cc-436f-9e7c-fff695088dfe => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:23:09.847955 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7e8d14e4-19f1-4382-a8ac-7082eec115e4 tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.267227 Jan 18 20:23:09.848587 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 7/24] 10.222.0.67 () {58 vars in 1133 bytes} [Tue Jan 18 20:23:09 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:09.873938 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-96ef94d6-a91d-40cb-9649-a648ae7a418c tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] Calling method '.version_select at 0x7f1788284c10>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:10.334347 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-96ef94d6-a91d-40cb-9649-a648ae7a418c tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.465255 Jan 18 20:23:10.336686 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 18/25] 10.222.0.67 () {58 vars in 1148 bytes} [Tue Jan 18 20:23:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:10.357702 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7536eb1f-25d2-46b1-a71e-780fa928771a tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] Calling method '.version_select at 0x7f1788230e50>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:10.398390 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-83a058ea-e6e1-4cf6-8bf2-cfdfc0d4054c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:10.399392 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-83a058ea-e6e1-4cf6-8bf2-cfdfc0d4054c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:10.421274 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83a058ea-e6e1-4cf6-8bf2-cfdfc0d4054c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:10.435774 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83a058ea-e6e1-4cf6-8bf2-cfdfc0d4054c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:10.437207 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83a058ea-e6e1-4cf6-8bf2-cfdfc0d4054c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:10.448014 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83a058ea-e6e1-4cf6-8bf2-cfdfc0d4054c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:10.918333 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7536eb1f-25d2-46b1-a71e-780fa928771a tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.565261 Jan 18 20:23:10.923635 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 8/26] 10.222.0.67 () {58 vars in 1133 bytes} [Tue Jan 18 20:23:10 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:10.935880 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-6a9767af-3f6e-4a32-8c86-df8f0b2787aa tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:10.949028 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-6a9767af-3f6e-4a32-8c86-df8f0b2787aa tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:10.965930 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6a9767af-3f6e-4a32-8c86-df8f0b2787aa tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:10.966478 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6a9767af-3f6e-4a32-8c86-df8f0b2787aa tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:10.967410 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6a9767af-3f6e-4a32-8c86-df8f0b2787aa tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:10.967935 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6a9767af-3f6e-4a32-8c86-df8f0b2787aa tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:11.198329 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-6a9767af-3f6e-4a32-8c86-df8f0b2787aa tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:11.216914 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-6a9767af-3f6e-4a32-8c86-df8f0b2787aa tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1272 microversion: 2.1 time: 0.291727 Jan 18 20:23:11.231953 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-83a058ea-e6e1-4cf6-8bf2-cfdfc0d4054c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:11.234144 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 9/27] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:10 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1272 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:11.244529 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4d0f40aa-7c16-4c12-826b-20c2b108597c tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Calling method '.version_select at 0x7f1788230160>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:11.247302 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-83a058ea-e6e1-4cf6-8bf2-cfdfc0d4054c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1278 microversion: 2.1 time: 0.848615 Jan 18 20:23:11.250880 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 19/28] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:10 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1278 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:11.256684 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-60ef9ffe-72ab-4b70-9567-5ee07e43c9d6 tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] Calling method '.version_select at 0x7f1788233e50>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:11.299550 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-4d0f40aa-7c16-4c12-826b-20c2b108597c tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] HTTP exception thrown: Snapshot 75d1dbca-48cc-436f-9e7c-fff695088dfe could not be found. Jan 18 20:23:11.300474 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4d0f40aa-7c16-4c12-826b-20c2b108597c tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Returning 404 to user: Snapshot 75d1dbca-48cc-436f-9e7c-fff695088dfe could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:23:11.301396 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-4d0f40aa-7c16-4c12-826b-20c2b108597c tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/75d1dbca-48cc-436f-9e7c-fff695088dfe" status: 404 len: 111 microversion: 2.1 time: 0.065831 Jan 18 20:23:11.305443 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 10/29] 10.222.0.67 () {58 vars in 1250 bytes} [Tue Jan 18 20:23:11 2022] GET /compute/v2.1/os-snapshots/75d1dbca-48cc-436f-9e7c-fff695088dfe => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:23:11.325360 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-c3b102e2-414e-45d5-b9c7-dffd725f15a1 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Calling method '.version_select at 0x7f1788b50820>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:11.575114 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-c3b102e2-414e-45d5-b9c7-dffd725f15a1 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/cdffcddb-d8ab-48aa-a26d-1cee1bad146a" status: 202 len: 0 microversion: 2.1 time: 0.259593 Jan 18 20:23:11.576103 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 11/30] 10.222.0.67 () {58 vars in 1247 bytes} [Tue Jan 18 20:23:11 2022] DELETE /compute/v2.1/os-volumes/cdffcddb-d8ab-48aa-a26d-1cee1bad146a => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:23:11.586012 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-dda1589a-7527-447f-9809-d47d0f430976 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Calling method '.version_select at 0x7f1788230ee0>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:11.670965 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-60ef9ffe-72ab-4b70-9567-5ee07e43c9d6 tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.417451 Jan 18 20:23:11.672845 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 20/31] 10.222.0.67 () {58 vars in 1166 bytes} [Tue Jan 18 20:23:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:11.690331 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bf67427c-92b7-445f-a25a-abbcb6d1b87e tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] Calling method '.version_select at 0x7f178823c0d0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:11.777695 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-dda1589a-7527-447f-9809-d47d0f430976 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/cdffcddb-d8ab-48aa-a26d-1cee1bad146a" status: 200 len: 345 microversion: 2.1 time: 0.140587 Jan 18 20:23:11.777695 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 12/32] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Jan 18 20:23:11 2022] GET /compute/v2.1/os-volumes/cdffcddb-d8ab-48aa-a26d-1cee1bad146a => generated 345 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:12.051328 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bf67427c-92b7-445f-a25a-abbcb6d1b87e tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.364644 Jan 18 20:23:12.051915 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 21/33] 10.222.0.67 () {58 vars in 1169 bytes} [Tue Jan 18 20:23:11 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:23:12.066439 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f46adb70-d9e4-4c7a-8cf4-e534b7f98b16 tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] Calling method '.version_select at 0x7f17882305e0>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:12.239309 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0e6154bf-e85d-49ff-bfc8-9199ddd6654f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:12.240399 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0e6154bf-e85d-49ff-bfc8-9199ddd6654f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:12.259388 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0e6154bf-e85d-49ff-bfc8-9199ddd6654f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:12.265147 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0e6154bf-e85d-49ff-bfc8-9199ddd6654f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:12.269357 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0e6154bf-e85d-49ff-bfc8-9199ddd6654f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:12.277551 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0e6154bf-e85d-49ff-bfc8-9199ddd6654f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:12.762484 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-f46adb70-d9e4-4c7a-8cf4-e534b7f98b16 tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.700496 Jan 18 20:23:12.763088 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 13/34] 10.222.0.67 () {58 vars in 1154 bytes} [Tue Jan 18 20:23:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:12.768874 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-913fd2f5-3e22-4172-9993-5c196ac859c0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:12.772315 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-913fd2f5-3e22-4172-9993-5c196ac859c0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:12.806998 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-913fd2f5-3e22-4172-9993-5c196ac859c0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:12.814723 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-913fd2f5-3e22-4172-9993-5c196ac859c0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:12.816935 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-913fd2f5-3e22-4172-9993-5c196ac859c0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:12.838153 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-913fd2f5-3e22-4172-9993-5c196ac859c0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:13.322037 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-913fd2f5-3e22-4172-9993-5c196ac859c0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:13.364855 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-913fd2f5-3e22-4172-9993-5c196ac859c0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1276 microversion: 2.1 time: 0.595789 Jan 18 20:23:13.378859 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 14/35] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:12 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1276 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:13.407337 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fc8f21ee-0d6f-4fd5-bd40-8897bc351ec8 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Calling method '.version_select at 0x7f17895c84c0>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:13.513808 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-fc8f21ee-0d6f-4fd5-bd40-8897bc351ec8 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] HTTP exception thrown: Volume cdffcddb-d8ab-48aa-a26d-1cee1bad146a could not be found. Jan 18 20:23:13.516345 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fc8f21ee-0d6f-4fd5-bd40-8897bc351ec8 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Returning 404 to user: Volume cdffcddb-d8ab-48aa-a26d-1cee1bad146a could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:23:13.517214 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-fc8f21ee-0d6f-4fd5-bd40-8897bc351ec8 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/cdffcddb-d8ab-48aa-a26d-1cee1bad146a" status: 404 len: 109 microversion: 2.1 time: 0.145587 Jan 18 20:23:13.519930 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 15/36] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Jan 18 20:23:13 2022] GET /compute/v2.1/os-volumes/cdffcddb-d8ab-48aa-a26d-1cee1bad146a => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:23:13.536874 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-eb4838b4-9c6e-425e-b9ae-2772db8aebd8 tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] Calling method '.version_select at 0x7f178823fc10>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:13.902999 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-eb4838b4-9c6e-425e-b9ae-2772db8aebd8 tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.381080 Jan 18 20:23:13.903891 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 16/37] 10.222.0.67 () {58 vars in 1187 bytes} [Tue Jan 18 20:23:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:13.915719 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-44d82fa1-d04e-4159-b0c3-c5a5c4150986 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Calling method '.version_select at 0x7f17895c8550>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:13.916541 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0e6154bf-e85d-49ff-bfc8-9199ddd6654f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:13.932379 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0e6154bf-e85d-49ff-bfc8-9199ddd6654f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1272 microversion: 2.1 time: 1.697980 Jan 18 20:23:13.944517 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 22/38] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:12 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1272 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:13.955953 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0ff28e95-1ec4-4332-ab47-e4190804bbc9 tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] Calling method '.version_select at 0x7f1788233af0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:13.998011 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-44d82fa1-d04e-4159-b0c3-c5a5c4150986 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] HTTP exception thrown: Volume cdffcddb-d8ab-48aa-a26d-1cee1bad146a could not be found. Jan 18 20:23:14.001412 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-44d82fa1-d04e-4159-b0c3-c5a5c4150986 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Returning 404 to user: Volume cdffcddb-d8ab-48aa-a26d-1cee1bad146a could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:23:14.004400 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-44d82fa1-d04e-4159-b0c3-c5a5c4150986 tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/cdffcddb-d8ab-48aa-a26d-1cee1bad146a" status: 404 len: 109 microversion: 2.1 time: 0.098326 Jan 18 20:23:14.009389 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 17/39] 10.222.0.67 () {58 vars in 1247 bytes} [Tue Jan 18 20:23:13 2022] DELETE /compute/v2.1/os-volumes/cdffcddb-d8ab-48aa-a26d-1cee1bad146a => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:23:14.035807 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5ef43508-caf0-49cb-9a31-ed5efbe8423e tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Calling method '.version_select at 0x7f178828dd30>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:14.197518 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-5ef43508-caf0-49cb-9a31-ed5efbe8423e tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] HTTP exception thrown: Volume cdffcddb-d8ab-48aa-a26d-1cee1bad146a could not be found. Jan 18 20:23:14.198968 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5ef43508-caf0-49cb-9a31-ed5efbe8423e tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] Returning 404 to user: Volume cdffcddb-d8ab-48aa-a26d-1cee1bad146a could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:23:14.200079 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-5ef43508-caf0-49cb-9a31-ed5efbe8423e tempest-VolumesSnapshotsTestJSON-459681866 tempest-VolumesSnapshotsTestJSON-459681866-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/cdffcddb-d8ab-48aa-a26d-1cee1bad146a" status: 404 len: 109 microversion: 2.1 time: 0.184737 Jan 18 20:23:14.201127 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 18/40] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Jan 18 20:23:14 2022] GET /compute/v2.1/os-volumes/cdffcddb-d8ab-48aa-a26d-1cee1bad146a => generated 109 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:23:14.281683 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0ff28e95-1ec4-4332-ab47-e4190804bbc9 tempest-VolumesTestJSON-692849036 tempest-VolumesTestJSON-692849036-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.335502 Jan 18 20:23:14.282448 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 23/41] 10.222.0.67 () {58 vars in 1154 bytes} [Tue Jan 18 20:23:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:14.388937 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-bc9d3ee9-a856-441b-8244-1dd0d3eb18c7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:14.390453 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-bc9d3ee9-a856-441b-8244-1dd0d3eb18c7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:14.405198 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bc9d3ee9-a856-441b-8244-1dd0d3eb18c7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:14.411836 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bc9d3ee9-a856-441b-8244-1dd0d3eb18c7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:14.413799 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bc9d3ee9-a856-441b-8244-1dd0d3eb18c7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:14.414493 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bc9d3ee9-a856-441b-8244-1dd0d3eb18c7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:14.728237 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-bc9d3ee9-a856-441b-8244-1dd0d3eb18c7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:14.745905 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-bc9d3ee9-a856-441b-8244-1dd0d3eb18c7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1276 microversion: 2.1 time: 0.362505 Jan 18 20:23:14.747822 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 19/42] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:14 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1276 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:14.950041 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f5102028-87ed-45c8-a9bd-58320a58fca3 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:14.950990 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f5102028-87ed-45c8-a9bd-58320a58fca3 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:14.973293 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f5102028-87ed-45c8-a9bd-58320a58fca3 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:14.974156 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f5102028-87ed-45c8-a9bd-58320a58fca3 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:14.975895 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f5102028-87ed-45c8-a9bd-58320a58fca3 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:14.978568 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f5102028-87ed-45c8-a9bd-58320a58fca3 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:15.252245 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f5102028-87ed-45c8-a9bd-58320a58fca3 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:15.276118 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f5102028-87ed-45c8-a9bd-58320a58fca3 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1272 microversion: 2.1 time: 0.319557 Jan 18 20:23:15.286977 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 24/43] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:14 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1272 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:15.766799 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-6afeccfd-1492-475f-aa74-6b3f53d8d17b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:15.768380 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-6afeccfd-1492-475f-aa74-6b3f53d8d17b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:15.818458 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6afeccfd-1492-475f-aa74-6b3f53d8d17b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:15.819149 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6afeccfd-1492-475f-aa74-6b3f53d8d17b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:15.820462 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6afeccfd-1492-475f-aa74-6b3f53d8d17b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:15.832826 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6afeccfd-1492-475f-aa74-6b3f53d8d17b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:16.294794 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3565fc7b-0f40-4944-ae87-fb1a98819d49 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:16.296161 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3565fc7b-0f40-4944-ae87-fb1a98819d49 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:16.311136 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3565fc7b-0f40-4944-ae87-fb1a98819d49 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:16.318335 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3565fc7b-0f40-4944-ae87-fb1a98819d49 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:16.323126 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3565fc7b-0f40-4944-ae87-fb1a98819d49 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:16.325509 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3565fc7b-0f40-4944-ae87-fb1a98819d49 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:16.791525 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-6afeccfd-1492-475f-aa74-6b3f53d8d17b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:16.821735 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-6afeccfd-1492-475f-aa74-6b3f53d8d17b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1276 microversion: 2.1 time: 1.058320 Jan 18 20:23:16.823328 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 20/44] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:15 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1276 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:19.009157 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-2a3eff9e-0c9a-4343-b1ac-3e734416a02e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'create', calling method: .version_select at 0x7f1788230ee0>, body: {"keypair": {"name": "tempest-keypair-1268719309"}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:19.154184 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-2a3eff9e-0c9a-4343-b1ac-3e734416a02e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Getting quotas for project 56295fd7b6c447b4a143879d64dd49da. Resources: {'key_pairs'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:23:19.169827 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-2a3eff9e-0c9a-4343-b1ac-3e734416a02e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Getting quotas for user 526b24d5cecf4e078cd5188062e959f6 and project 56295fd7b6c447b4a143879d64dd49da. Resources: {'key_pairs'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:23:19.753447 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3565fc7b-0f40-4944-ae87-fb1a98819d49 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:19.800675 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3565fc7b-0f40-4944-ae87-fb1a98819d49 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1314 microversion: 2.1 time: 3.499232 Jan 18 20:23:19.808801 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 25/45] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:16 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1314 bytes in 3518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:19.843482 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9a6e20a8-148c-44a2-8f14-1fc31c0120d1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:19.845538 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9a6e20a8-148c-44a2-8f14-1fc31c0120d1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:19.880497 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9a6e20a8-148c-44a2-8f14-1fc31c0120d1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:19.885451 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9a6e20a8-148c-44a2-8f14-1fc31c0120d1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:19.888287 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9a6e20a8-148c-44a2-8f14-1fc31c0120d1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:19.889321 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9a6e20a8-148c-44a2-8f14-1fc31c0120d1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:20.497737 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-2a3eff9e-0c9a-4343-b1ac-3e734416a02e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Getting quotas for project 56295fd7b6c447b4a143879d64dd49da. Resources: {'key_pairs'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:23:20.514487 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-2a3eff9e-0c9a-4343-b1ac-3e734416a02e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Getting quotas for user 526b24d5cecf4e078cd5188062e959f6 and project 56295fd7b6c447b4a143879d64dd49da. Resources: {'key_pairs'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:23:20.569247 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2a3eff9e-0c9a-4343-b1ac-3e734416a02e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 2.833313 Jan 18 20:23:20.576334 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 21/46] 10.222.0.67 () {60 vars in 1157 bytes} [Tue Jan 18 20:23:17 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 2842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:20.838983 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d4abad7b-7705-4654-85dc-9f798214f620 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:20.841476 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d4abad7b-7705-4654-85dc-9f798214f620 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:20.876908 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d4abad7b-7705-4654-85dc-9f798214f620 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:20.881176 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d4abad7b-7705-4654-85dc-9f798214f620 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:20.892266 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d4abad7b-7705-4654-85dc-9f798214f620 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:20.893498 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d4abad7b-7705-4654-85dc-9f798214f620 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:22.011400 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d4abad7b-7705-4654-85dc-9f798214f620 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:22.073183 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d4abad7b-7705-4654-85dc-9f798214f620 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1314 microversion: 2.1 time: 1.239256 Jan 18 20:23:22.075584 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 22/47] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:20 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1314 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:23.249099 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ebbc86b3-7343-485d-b3f2-d48013f215a4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1075835673", "imageRef": "c7d259ac-b206-430f-a3c0-794cee408236", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b1ba40c-a9a4-429c-93aa-b6b26304e073"}]}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:23.321431 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9a6e20a8-148c-44a2-8f14-1fc31c0120d1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:23.352198 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9a6e20a8-148c-44a2-8f14-1fc31c0120d1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1318 microversion: 2.1 time: 3.541768 Jan 18 20:23:23.358829 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 26/48] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:19 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1318 bytes in 3549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:23.376197 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f200bbcb-a9ba-4bc8-bf80-205059dfc590 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:23.377079 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f200bbcb-a9ba-4bc8-bf80-205059dfc590 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:23.400414 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f200bbcb-a9ba-4bc8-bf80-205059dfc590 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:23.401991 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.network.neutron [None req-ebbc86b3-7343-485d-b3f2-d48013f215a4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] validate_networks() for [('4b1ba40c-a9a4-429c-93aa-b6b26304e073', None, None, None, None, None)] {{(pid=116376) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:23:23.402778 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f200bbcb-a9ba-4bc8-bf80-205059dfc590 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:23.404276 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f200bbcb-a9ba-4bc8-bf80-205059dfc590 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:23.409247 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f200bbcb-a9ba-4bc8-bf80-205059dfc590 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:25.253171 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f200bbcb-a9ba-4bc8-bf80-205059dfc590 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:25.261960 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f200bbcb-a9ba-4bc8-bf80-205059dfc590 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1314 microversion: 2.1 time: 1.900547 Jan 18 20:23:25.271712 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 27/49] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:23 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1314 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:25.276492 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ceb809a9-5eae-4eb6-a33a-e7e3cf70e3b2 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:25.277497 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ceb809a9-5eae-4eb6-a33a-e7e3cf70e3b2 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:25.293029 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ceb809a9-5eae-4eb6-a33a-e7e3cf70e3b2 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:25.295503 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ceb809a9-5eae-4eb6-a33a-e7e3cf70e3b2 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:25.296589 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ceb809a9-5eae-4eb6-a33a-e7e3cf70e3b2 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:25.298762 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ceb809a9-5eae-4eb6-a33a-e7e3cf70e3b2 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:25.577950 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-ebbc86b3-7343-485d-b3f2-d48013f215a4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Flavor limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:23:25.581081 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-ebbc86b3-7343-485d-b3f2-d48013f215a4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Image limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:23:25.583184 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-ebbc86b3-7343-485d-b3f2-d48013f215a4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Flavor pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:23:25.584643 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-ebbc86b3-7343-485d-b3f2-d48013f215a4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Image pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:23:25.587116 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-ebbc86b3-7343-485d-b3f2-d48013f215a4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:23:25.608003 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ebbc86b3-7343-485d-b3f2-d48013f215a4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:25.609353 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ebbc86b3-7343-485d-b3f2-d48013f215a4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:25.612481 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ebbc86b3-7343-485d-b3f2-d48013f215a4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:25.614040 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ebbc86b3-7343-485d-b3f2-d48013f215a4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:25.664323 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-ebbc86b3-7343-485d-b3f2-d48013f215a4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Getting quotas for project b05e2986ebac459eaec991a4315a88d3. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:23:25.702428 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-ebbc86b3-7343-485d-b3f2-d48013f215a4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Getting quotas for user 69daca25d99340b6bba224d51a958852 and project b05e2986ebac459eaec991a4315a88d3. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:23:25.788765 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ebbc86b3-7343-485d-b3f2-d48013f215a4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Going to run 1 instances... {{(pid=116376) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:23:25.796805 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ebbc86b3-7343-485d-b3f2-d48013f215a4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7d259ac-b206-430f-a3c0-794cee408236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116376) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:23:25.945411 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ceb809a9-5eae-4eb6-a33a-e7e3cf70e3b2 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:25.982972 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ceb809a9-5eae-4eb6-a33a-e7e3cf70e3b2 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1318 microversion: 2.1 time: 0.709651 Jan 18 20:23:25.997832 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 28/50] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:25 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1318 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:26.172611 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ebbc86b3-7343-485d-b3f2-d48013f215a4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.429800 Jan 18 20:23:26.178840 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 23/51] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:23:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 3447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 20:23:26.237677 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-9dbc5887-1dfc-4c14-b773-b04525570940 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:26.245633 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-9dbc5887-1dfc-4c14-b773-b04525570940 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:26.433491 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-9dbc5887-1dfc-4c14-b773-b04525570940 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:26.462307 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-9dbc5887-1dfc-4c14-b773-b04525570940 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1222 microversion: 2.1 time: 0.270751 Jan 18 20:23:26.466570 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 24/52] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:26 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1222 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:26.481288 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b3a5fc47-7fcb-4439-bc00-c71083370c3a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:26.486622 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b3a5fc47-7fcb-4439-bc00-c71083370c3a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:26.510613 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b3a5fc47-7fcb-4439-bc00-c71083370c3a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:26.511265 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b3a5fc47-7fcb-4439-bc00-c71083370c3a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:26.522510 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b3a5fc47-7fcb-4439-bc00-c71083370c3a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:26.534427 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b3a5fc47-7fcb-4439-bc00-c71083370c3a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:27.266161 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b3a5fc47-7fcb-4439-bc00-c71083370c3a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:27.283404 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b3a5fc47-7fcb-4439-bc00-c71083370c3a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1314 microversion: 2.1 time: 0.809943 Jan 18 20:23:27.284705 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 25/53] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:26 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1314 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:27.300378 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-33185045-7a60-4d95-b6ec-f94add484e46 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:27.301432 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-33185045-7a60-4d95-b6ec-f94add484e46 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:27.321950 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-33185045-7a60-4d95-b6ec-f94add484e46 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:27.322825 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-33185045-7a60-4d95-b6ec-f94add484e46 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:27.324022 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-33185045-7a60-4d95-b6ec-f94add484e46 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:27.331859 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-33185045-7a60-4d95-b6ec-f94add484e46 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:27.593931 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d2d98448-7202-458d-93a8-bc224d49b19c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'create', calling method: .version_select at 0x7f17882ec1f0>, body: {"keypair": {"name": "tempest-keypair-748024130"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:27.650120 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-d2d98448-7202-458d-93a8-bc224d49b19c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Getting quotas for project 9d6dd542180144d480be34c9a555ae63. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:23:27.661659 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-d2d98448-7202-458d-93a8-bc224d49b19c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Getting quotas for user b40e1486b9184e25b89c064fb56673df and project 9d6dd542180144d480be34c9a555ae63. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:23:27.743721 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-33185045-7a60-4d95-b6ec-f94add484e46 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:27.756489 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-33185045-7a60-4d95-b6ec-f94add484e46 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1318 microversion: 2.1 time: 0.470469 Jan 18 20:23:27.765966 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 26/54] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:27 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:27.787632 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ca5e5e76-5e64-4617-bbb6-e6c6ad449013 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1238446270", "imageRef": "c7d259ac-b206-430f-a3c0-794cee408236", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b1ba40c-a9a4-429c-93aa-b6b26304e073"}]}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:27.947499 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.network.neutron [None req-ca5e5e76-5e64-4617-bbb6-e6c6ad449013 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] validate_networks() for [('4b1ba40c-a9a4-429c-93aa-b6b26304e073', None, None, None, None, None)] {{(pid=116376) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:23:28.945030 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-d2d98448-7202-458d-93a8-bc224d49b19c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Getting quotas for project 9d6dd542180144d480be34c9a555ae63. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:23:28.966433 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-d2d98448-7202-458d-93a8-bc224d49b19c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Getting quotas for user b40e1486b9184e25b89c064fb56673df and project 9d6dd542180144d480be34c9a555ae63. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:23:29.008439 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d2d98448-7202-458d-93a8-bc224d49b19c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 3.006129 Jan 18 20:23:29.009909 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 29/55] 10.222.0.67 () {62 vars in 1198 bytes} [Tue Jan 18 20:23:25 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 3011 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 18 20:23:29.024634 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-826f593e-2403-4eaa-b838-0adff0d89f01 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:29.027790 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-826f593e-2403-4eaa-b838-0adff0d89f01 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:29.047641 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-826f593e-2403-4eaa-b838-0adff0d89f01 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:29.051734 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-826f593e-2403-4eaa-b838-0adff0d89f01 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:29.056193 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-826f593e-2403-4eaa-b838-0adff0d89f01 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:29.058217 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-826f593e-2403-4eaa-b838-0adff0d89f01 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:31.216621 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-ca5e5e76-5e64-4617-bbb6-e6c6ad449013 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Flavor limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:23:31.218395 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-ca5e5e76-5e64-4617-bbb6-e6c6ad449013 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Image limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:23:31.219566 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-ca5e5e76-5e64-4617-bbb6-e6c6ad449013 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Flavor pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:23:31.220580 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-ca5e5e76-5e64-4617-bbb6-e6c6ad449013 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Image pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:23:31.221576 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-ca5e5e76-5e64-4617-bbb6-e6c6ad449013 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:23:31.267114 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ca5e5e76-5e64-4617-bbb6-e6c6ad449013 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:31.267925 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ca5e5e76-5e64-4617-bbb6-e6c6ad449013 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:31.269541 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ca5e5e76-5e64-4617-bbb6-e6c6ad449013 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:31.270206 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ca5e5e76-5e64-4617-bbb6-e6c6ad449013 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:31.411977 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-ca5e5e76-5e64-4617-bbb6-e6c6ad449013 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Getting quotas for project b05e2986ebac459eaec991a4315a88d3. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:23:31.443615 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-ca5e5e76-5e64-4617-bbb6-e6c6ad449013 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Getting quotas for user 69daca25d99340b6bba224d51a958852 and project b05e2986ebac459eaec991a4315a88d3. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:23:31.508287 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ca5e5e76-5e64-4617-bbb6-e6c6ad449013 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Going to run 1 instances... {{(pid=116376) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:23:31.527349 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ca5e5e76-5e64-4617-bbb6-e6c6ad449013 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7d259ac-b206-430f-a3c0-794cee408236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116376) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:23:31.794736 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ca5e5e76-5e64-4617-bbb6-e6c6ad449013 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.023081 Jan 18 20:23:31.801482 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 27/56] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:23:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 4033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 20:23:32.170071 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-826f593e-2403-4eaa-b838-0adff0d89f01 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:32.184809 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-826f593e-2403-4eaa-b838-0adff0d89f01 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1314 microversion: 2.1 time: 3.172381 Jan 18 20:23:32.196000 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 30/57] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:29 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1314 bytes in 3175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:32.200015 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-258ac91a-83b1-4e8b-b19d-a839ecbe5715 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:32.216398 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-258ac91a-83b1-4e8b-b19d-a839ecbe5715 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:32.249732 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-258ac91a-83b1-4e8b-b19d-a839ecbe5715 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:32.250080 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-258ac91a-83b1-4e8b-b19d-a839ecbe5715 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:32.252983 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-258ac91a-83b1-4e8b-b19d-a839ecbe5715 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:32.256273 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-258ac91a-83b1-4e8b-b19d-a839ecbe5715 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:32.908037 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-258ac91a-83b1-4e8b-b19d-a839ecbe5715 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:32.908883 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-d6d00e27-1033-450d-9f8d-b9942a63c338 req-4f0d9210-938c-46c6-a1cb-406d3aeb7ded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2962a0f0-ce3a-4351-84d7-f3155f5bd129", "tag": "606d225c-d6f1-491e-8ba1-c66d52808c4b"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:32.922192 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:23:32.922192 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:23:32.933750 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-258ac91a-83b1-4e8b-b19d-a839ecbe5715 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1318 microversion: 2.1 time: 0.746863 Jan 18 20:23:32.934372 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 31/58] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:32 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1318 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:32.987550 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-d6d00e27-1033-450d-9f8d-b9942a63c338 req-4f0d9210-938c-46c6-a1cb-406d3aeb7ded service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:32.990791 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-d6d00e27-1033-450d-9f8d-b9942a63c338 req-4f0d9210-938c-46c6-a1cb-406d3aeb7ded service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:33.048180 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-d6d00e27-1033-450d-9f8d-b9942a63c338 req-4f0d9210-938c-46c6-a1cb-406d3aeb7ded service nova] Creating event network-changed:606d225c-d6f1-491e-8ba1-c66d52808c4b for instance 2962a0f0-ce3a-4351-84d7-f3155f5bd129 on hv-cinder-82160 Jan 18 20:23:33.049858 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-d6d00e27-1033-450d-9f8d-b9942a63c338 req-4f0d9210-938c-46c6-a1cb-406d3aeb7ded service nova] Acquired lock "compute-rpcapi-router" {{(pid=116376) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 18 20:23:33.053760 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2b7fcf69-60ec-42d9-806a-78b230d2a43c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:33.054739 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2b7fcf69-60ec-42d9-806a-78b230d2a43c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:33.055964 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2b7fcf69-60ec-42d9-806a-78b230d2a43c None None] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:33.056600 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2b7fcf69-60ec-42d9-806a-78b230d2a43c None None] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:33.073176 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.compute.rpcapi [None req-2b7fcf69-60ec-42d9-806a-78b230d2a43c None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 18 20:23:33.076196 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2b7fcf69-60ec-42d9-806a-78b230d2a43c None None] Releasing lock "compute-rpcapi-router" {{(pid=116376) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 18 20:23:33.114174 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2b7fcf69-60ec-42d9-806a-78b230d2a43c None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.299644 Jan 18 20:23:33.117502 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 28/59] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:33.126218 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7b550d12-5843-4e05-9921-b94a997b9bc5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:33.127650 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-7b550d12-5843-4e05-9921-b94a997b9bc5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:33.138374 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7b550d12-5843-4e05-9921-b94a997b9bc5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:33.139075 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7b550d12-5843-4e05-9921-b94a997b9bc5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:33.143025 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7b550d12-5843-4e05-9921-b94a997b9bc5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:33.144546 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7b550d12-5843-4e05-9921-b94a997b9bc5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:33.309649 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e3906734-88c8-4997-8df1-6430769a496b tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] Action: 'create', calling method: .version_select at 0x7f1788284670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-918725624", "metadata": {"Type": "work"}}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:33.310937 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e3906734-88c8-4997-8df1-6430769a496b tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:23:33.312049 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e3906734-88c8-4997-8df1-6430769a496b tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.376712 Jan 18 20:23:33.314650 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 32/60] 10.222.0.67 () {60 vars in 1155 bytes} [Tue Jan 18 20:23:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 380 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 18 20:23:33.331550 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-367d985a-3950-44b6-8c72-6f835d024ef5 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:33.332527 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-367d985a-3950-44b6-8c72-6f835d024ef5 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:33.339871 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-7b550d12-5843-4e05-9921-b94a997b9bc5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:33.354008 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7b550d12-5843-4e05-9921-b94a997b9bc5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1226 microversion: 2.1 time: 0.234743 Jan 18 20:23:33.356417 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-367d985a-3950-44b6-8c72-6f835d024ef5 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:33.357393 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 29/61] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:33 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1226 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:33.359583 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-367d985a-3950-44b6-8c72-6f835d024ef5 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:33.360727 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-367d985a-3950-44b6-8c72-6f835d024ef5 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:33.361649 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-367d985a-3950-44b6-8c72-6f835d024ef5 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:33.371750 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fa818346-5e65-451b-89e5-8b42c6799b0e tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] Action: 'create', calling method: .version_select at 0x7f17882031f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-905423049", "metadata": {"Type": "work"}}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:33.373693 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fa818346-5e65-451b-89e5-8b42c6799b0e tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:23:33.375232 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-fa818346-5e65-451b-89e5-8b42c6799b0e tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016614 Jan 18 20:23:33.378038 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 30/62] 10.222.0.67 () {60 vars in 1155 bytes} [Tue Jan 18 20:23:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 18 20:23:33.393036 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a95ca7d8-2a2a-46d4-bcd2-ee3e6606431c tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] Action: 'create', calling method: .version_select at 0x7f17881a03a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2059862196", "metadata": {"Type": "work"}}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:33.394706 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a95ca7d8-2a2a-46d4-bcd2-ee3e6606431c tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:23:33.400109 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a95ca7d8-2a2a-46d4-bcd2-ee3e6606431c tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015638 Jan 18 20:23:33.400887 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 31/63] 10.222.0.67 () {60 vars in 1155 bytes} [Tue Jan 18 20:23:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 18 20:23:33.421181 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5037b178-3a64-4d93-96d5-949f2417dbfe tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] Calling method '.version_select at 0x7f1788b50820>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:33.547955 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-5037b178-3a64-4d93-96d5-949f2417dbfe tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] HTTP exception thrown: Volume tempest-invalid-397980696 could not be found. Jan 18 20:23:33.548575 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5037b178-3a64-4d93-96d5-949f2417dbfe tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] Returning 404 to user: Volume tempest-invalid-397980696 could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:23:33.549493 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-5037b178-3a64-4d93-96d5-949f2417dbfe tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/tempest-invalid-397980696" status: 404 len: 98 microversion: 2.1 time: 0.139749 Jan 18 20:23:33.550530 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 32/64] 10.222.0.67 () {58 vars in 1214 bytes} [Tue Jan 18 20:23:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-397980696 => generated 98 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 18 20:23:33.565980 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ef422470-09d0-4871-941a-cb1b286f254f tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003741 Jan 18 20:23:33.566848 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 33/65] 10.222.0.67 () {58 vars in 1139 bytes} [Tue Jan 18 20:23:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 18 20:23:33.577850 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2b0ec7fc-d4fc-479c-9bb7-dec11fe49585 tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003740 Jan 18 20:23:33.578628 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 34/66] 10.222.0.67 () {58 vars in 1136 bytes} [Tue Jan 18 20:23:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 18 20:23:33.590265 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e948baf1-854d-4d15-b28e-d5ce22bf465e tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] Calling method '.version_select at 0x7f17882033a0>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:33.634983 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-e948baf1-854d-4d15-b28e-d5ce22bf465e tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] HTTP exception thrown: Volume 51e20367-9dd3-44f2-b57d-d6d604c63c22 could not be found. Jan 18 20:23:33.635615 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e948baf1-854d-4d15-b28e-d5ce22bf465e tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] Returning 404 to user: Volume 51e20367-9dd3-44f2-b57d-d6d604c63c22 could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:23:33.636549 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e948baf1-854d-4d15-b28e-d5ce22bf465e tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/51e20367-9dd3-44f2-b57d-d6d604c63c22" status: 404 len: 109 microversion: 2.1 time: 0.050274 Jan 18 20:23:33.637133 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 35/67] 10.222.0.67 () {58 vars in 1247 bytes} [Tue Jan 18 20:23:33 2022] DELETE /compute/v2.1/os-volumes/51e20367-9dd3-44f2-b57d-d6d604c63c22 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 18 20:23:33.653576 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ecfa062e-8842-42c4-b3c4-8755cafa41a8 tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] Calling method '.version_select at 0x7f178823fc10>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:33.701011 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-ecfa062e-8842-42c4-b3c4-8755cafa41a8 tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] HTTP exception thrown: Volume 44c21a57-df44-4a54-924e-5078a1a73290 could not be found. Jan 18 20:23:33.701651 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ecfa062e-8842-42c4-b3c4-8755cafa41a8 tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] Returning 404 to user: Volume 44c21a57-df44-4a54-924e-5078a1a73290 could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:23:33.702547 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ecfa062e-8842-42c4-b3c4-8755cafa41a8 tempest-VolumesNegativeTest-1482981446 tempest-VolumesNegativeTest-1482981446-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/44c21a57-df44-4a54-924e-5078a1a73290" status: 404 len: 109 microversion: 2.1 time: 0.052833 Jan 18 20:23:33.704428 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 36/68] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Jan 18 20:23:33 2022] GET /compute/v2.1/os-volumes/44c21a57-df44-4a54-924e-5078a1a73290 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:23:33.968925 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-c2cbd3bf-2b7b-432b-bb70-99001cd22231 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:33.970354 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-c2cbd3bf-2b7b-432b-bb70-99001cd22231 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:33.995051 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c2cbd3bf-2b7b-432b-bb70-99001cd22231 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:33.999574 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c2cbd3bf-2b7b-432b-bb70-99001cd22231 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:34.001480 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c2cbd3bf-2b7b-432b-bb70-99001cd22231 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:34.011611 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c2cbd3bf-2b7b-432b-bb70-99001cd22231 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:34.524020 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-c2cbd3bf-2b7b-432b-bb70-99001cd22231 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:34.532211 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-c2cbd3bf-2b7b-432b-bb70-99001cd22231 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1318 microversion: 2.1 time: 0.567212 Jan 18 20:23:34.532931 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 37/69] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:33 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:34.542642 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7db0fb8c-187c-484a-87d3-fa02a761f95c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:34.553761 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-7db0fb8c-187c-484a-87d3-fa02a761f95c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:34.565071 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7db0fb8c-187c-484a-87d3-fa02a761f95c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:34.565810 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7db0fb8c-187c-484a-87d3-fa02a761f95c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:34.566829 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7db0fb8c-187c-484a-87d3-fa02a761f95c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:34.567467 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7db0fb8c-187c-484a-87d3-fa02a761f95c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:34.723508 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-367d985a-3950-44b6-8c72-6f835d024ef5 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:34.746110 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-367d985a-3950-44b6-8c72-6f835d024ef5 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1314 microversion: 2.1 time: 1.429910 Jan 18 20:23:34.766662 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 33/70] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:33 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1314 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:34.835443 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-7db0fb8c-187c-484a-87d3-fa02a761f95c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:34.843860 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7db0fb8c-187c-484a-87d3-fa02a761f95c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1280 microversion: 2.1 time: 0.304768 Jan 18 20:23:34.847815 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 38/71] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:34 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1280 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:35.337543 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-f19e903a-4cec-46da-a2a0-1034cd26dc0a req-b12790e8-3a55-4859-874c-946555653e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46334d7f-6fa1-41ba-bc9d-a80684750c70", "tag": "99714da3-e00f-44f4-9a6d-0775f70695dc"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:35.354799 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:23:35.354799 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:23:35.405458 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-f19e903a-4cec-46da-a2a0-1034cd26dc0a req-b12790e8-3a55-4859-874c-946555653e67 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:35.406292 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-f19e903a-4cec-46da-a2a0-1034cd26dc0a req-b12790e8-3a55-4859-874c-946555653e67 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:35.477327 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-f19e903a-4cec-46da-a2a0-1034cd26dc0a req-b12790e8-3a55-4859-874c-946555653e67 service nova] Creating event network-changed:99714da3-e00f-44f4-9a6d-0775f70695dc for instance 46334d7f-6fa1-41ba-bc9d-a80684750c70 on hv-cinder-82160 Jan 18 20:23:35.478153 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-f19e903a-4cec-46da-a2a0-1034cd26dc0a req-b12790e8-3a55-4859-874c-946555653e67 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116375) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 18 20:23:35.479613 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8acf97cd-797d-4745-937d-ecc42fa0b6a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:35.480294 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8acf97cd-797d-4745-937d-ecc42fa0b6a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:35.481322 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8acf97cd-797d-4745-937d-ecc42fa0b6a1 None None] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:35.483246 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8acf97cd-797d-4745-937d-ecc42fa0b6a1 None None] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:35.495362 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.compute.rpcapi [None req-8acf97cd-797d-4745-937d-ecc42fa0b6a1 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 18 20:23:35.496629 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8acf97cd-797d-4745-937d-ecc42fa0b6a1 None None] Releasing lock "compute-rpcapi-router" {{(pid=116375) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 18 20:23:35.544648 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8acf97cd-797d-4745-937d-ecc42fa0b6a1 None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215479 Jan 18 20:23:35.546093 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 34/72] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:35.562041 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d7b68cb4-340a-4e1c-9a6b-fc8f6044e8c3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:35.562780 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d7b68cb4-340a-4e1c-9a6b-fc8f6044e8c3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:35.575619 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d7b68cb4-340a-4e1c-9a6b-fc8f6044e8c3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:35.586429 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d7b68cb4-340a-4e1c-9a6b-fc8f6044e8c3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:35.587747 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d7b68cb4-340a-4e1c-9a6b-fc8f6044e8c3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:35.589472 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d7b68cb4-340a-4e1c-9a6b-fc8f6044e8c3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:35.779356 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-798480fe-583e-44ad-a468-2a1d1bf1ff1a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:35.780661 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-798480fe-583e-44ad-a468-2a1d1bf1ff1a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:35.803733 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-798480fe-583e-44ad-a468-2a1d1bf1ff1a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:35.804971 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-798480fe-583e-44ad-a468-2a1d1bf1ff1a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:35.806753 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-798480fe-583e-44ad-a468-2a1d1bf1ff1a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:35.810148 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-798480fe-583e-44ad-a468-2a1d1bf1ff1a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:36.514085 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-798480fe-583e-44ad-a468-2a1d1bf1ff1a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:36.533339 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-798480fe-583e-44ad-a468-2a1d1bf1ff1a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1314 microversion: 2.1 time: 0.761156 Jan 18 20:23:36.535770 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 35/73] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:35 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:36.572778 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a8fbffd3-0af6-4818-88e5-bb8b7aa43ffb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:36.578617 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a8fbffd3-0af6-4818-88e5-bb8b7aa43ffb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:36.603197 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a8fbffd3-0af6-4818-88e5-bb8b7aa43ffb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:36.604867 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a8fbffd3-0af6-4818-88e5-bb8b7aa43ffb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:36.608293 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a8fbffd3-0af6-4818-88e5-bb8b7aa43ffb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:36.609152 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a8fbffd3-0af6-4818-88e5-bb8b7aa43ffb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:36.680291 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d7b68cb4-340a-4e1c-9a6b-fc8f6044e8c3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:36.735878 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d7b68cb4-340a-4e1c-9a6b-fc8f6044e8c3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1318 microversion: 2.1 time: 1.172797 Jan 18 20:23:36.758046 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 39/74] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:35 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1318 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:36.785598 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5ba01de7-8bc6-4a65-a881-9364bc7562fa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-871968842", "imageRef": "c7d259ac-b206-430f-a3c0-794cee408236", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77f5e2c8-6d78-4c9e-bf28-d46a83b25db6"}], "security_groups": [{"name": "tempest-securitygroup--920139986"}], "key_name": "tempest-keypair-1268719309", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:36.989235 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a8fbffd3-0af6-4818-88e5-bb8b7aa43ffb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:37.033635 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a8fbffd3-0af6-4818-88e5-bb8b7aa43ffb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1280 microversion: 2.1 time: 0.494398 Jan 18 20:23:37.038551 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 36/75] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:36 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1280 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:37.405840 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.network.neutron [None req-5ba01de7-8bc6-4a65-a881-9364bc7562fa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] validate_networks() for [('77f5e2c8-6d78-4c9e-bf28-d46a83b25db6', None, None, None, None, None)] {{(pid=116376) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:23:37.575958 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-78996167-0d9a-47c9-b856-6a7ed7f2f39a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:37.582590 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-78996167-0d9a-47c9-b856-6a7ed7f2f39a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:37.633911 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-78996167-0d9a-47c9-b856-6a7ed7f2f39a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:37.636729 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-78996167-0d9a-47c9-b856-6a7ed7f2f39a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:37.642360 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-78996167-0d9a-47c9-b856-6a7ed7f2f39a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:37.647611 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-78996167-0d9a-47c9-b856-6a7ed7f2f39a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:38.140855 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-78996167-0d9a-47c9-b856-6a7ed7f2f39a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:38.168619 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-78996167-0d9a-47c9-b856-6a7ed7f2f39a tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1314 microversion: 2.1 time: 0.605801 Jan 18 20:23:38.172709 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 37/76] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:37 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:38.182802 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bc72f3c8-fc1f-479e-aba7-09af677129bb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:38.189520 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bc72f3c8-fc1f-479e-aba7-09af677129bb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:38.213328 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bc72f3c8-fc1f-479e-aba7-09af677129bb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:38.214880 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bc72f3c8-fc1f-479e-aba7-09af677129bb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:38.218071 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bc72f3c8-fc1f-479e-aba7-09af677129bb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:38.219021 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bc72f3c8-fc1f-479e-aba7-09af677129bb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:38.905574 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bc72f3c8-fc1f-479e-aba7-09af677129bb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:38.923873 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bc72f3c8-fc1f-479e-aba7-09af677129bb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1318 microversion: 2.1 time: 0.745871 Jan 18 20:23:38.937307 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 38/77] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:38 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1318 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:38.947532 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ac30180c-4ede-45d0-9faa-26aad1ccaade tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:38.951917 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ac30180c-4ede-45d0-9faa-26aad1ccaade tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:38.967812 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ac30180c-4ede-45d0-9faa-26aad1ccaade tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:38.969669 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ac30180c-4ede-45d0-9faa-26aad1ccaade tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:38.970496 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ac30180c-4ede-45d0-9faa-26aad1ccaade tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:38.970943 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ac30180c-4ede-45d0-9faa-26aad1ccaade tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:39.242719 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ac30180c-4ede-45d0-9faa-26aad1ccaade tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:39.255848 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ac30180c-4ede-45d0-9faa-26aad1ccaade tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1322 microversion: 2.1 time: 0.316520 Jan 18 20:23:39.256448 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 39/78] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:38 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:39.272408 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3699a0a6-21b1-4204-8045-5083b57edebf tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:39.273095 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3699a0a6-21b1-4204-8045-5083b57edebf tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:39.289443 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3699a0a6-21b1-4204-8045-5083b57edebf tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:39.290318 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3699a0a6-21b1-4204-8045-5083b57edebf tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:39.291540 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3699a0a6-21b1-4204-8045-5083b57edebf tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:39.292252 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3699a0a6-21b1-4204-8045-5083b57edebf tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:39.949981 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3699a0a6-21b1-4204-8045-5083b57edebf tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:39.968958 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3699a0a6-21b1-4204-8045-5083b57edebf tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1314 microversion: 2.1 time: 0.699670 Jan 18 20:23:39.971004 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 40/79] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:39 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1314 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:39.976549 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-01c824d0-4103-4fdb-85b7-6163684adcf5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:39.994527 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-01c824d0-4103-4fdb-85b7-6163684adcf5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:40.038135 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-01c824d0-4103-4fdb-85b7-6163684adcf5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:40.039009 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-01c824d0-4103-4fdb-85b7-6163684adcf5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:40.063917 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-01c824d0-4103-4fdb-85b7-6163684adcf5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:40.071871 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-01c824d0-4103-4fdb-85b7-6163684adcf5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:40.668094 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-5ba01de7-8bc6-4a65-a881-9364bc7562fa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Flavor limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:23:40.668972 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-5ba01de7-8bc6-4a65-a881-9364bc7562fa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Image limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:23:40.669129 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-5ba01de7-8bc6-4a65-a881-9364bc7562fa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Flavor pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:23:40.669448 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-5ba01de7-8bc6-4a65-a881-9364bc7562fa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Image pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:23:40.669864 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-5ba01de7-8bc6-4a65-a881-9364bc7562fa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:23:40.688783 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5ba01de7-8bc6-4a65-a881-9364bc7562fa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:40.689245 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5ba01de7-8bc6-4a65-a881-9364bc7562fa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:40.690293 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5ba01de7-8bc6-4a65-a881-9364bc7562fa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:40.691075 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5ba01de7-8bc6-4a65-a881-9364bc7562fa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:40.738468 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-01c824d0-4103-4fdb-85b7-6163684adcf5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:40.751063 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-5ba01de7-8bc6-4a65-a881-9364bc7562fa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Getting quotas for project 56295fd7b6c447b4a143879d64dd49da. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:23:40.778131 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-01c824d0-4103-4fdb-85b7-6163684adcf5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1318 microversion: 2.1 time: 0.805689 Jan 18 20:23:40.780261 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-5ba01de7-8bc6-4a65-a881-9364bc7562fa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Getting quotas for user 526b24d5cecf4e078cd5188062e959f6 and project 56295fd7b6c447b4a143879d64dd49da. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:23:40.781559 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 41/80] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:39 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1318 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:40.800847 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-df11d149-c216-4957-a341-025704f49f66 req-971a7920-0079-4818-a0f7-9f4b9a091c21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6", "tag": "81368d94-6b86-4c1a-84ec-fc21d1647ac5"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:40.814303 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:23:40.814303 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:23:40.830027 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-5ba01de7-8bc6-4a65-a881-9364bc7562fa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Going to run 1 instances... {{(pid=116376) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:23:40.837189 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-5ba01de7-8bc6-4a65-a881-9364bc7562fa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7d259ac-b206-430f-a3c0-794cee408236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116376) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:23:40.839453 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-df11d149-c216-4957-a341-025704f49f66 req-971a7920-0079-4818-a0f7-9f4b9a091c21 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:40.840277 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-df11d149-c216-4957-a341-025704f49f66 req-971a7920-0079-4818-a0f7-9f4b9a091c21 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:40.888030 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-df11d149-c216-4957-a341-025704f49f66 req-971a7920-0079-4818-a0f7-9f4b9a091c21 service nova] Creating event network-changed:81368d94-6b86-4c1a-84ec-fc21d1647ac5 for instance 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 on hv-cinder-82160 Jan 18 20:23:40.910881 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-df11d149-c216-4957-a341-025704f49f66 req-971a7920-0079-4818-a0f7-9f4b9a091c21 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119787 Jan 18 20:23:40.914065 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 42/81] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:40.932031 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ebf7195d-db92-4337-a202-1ac2dcdf77c7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:40.940025 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ebf7195d-db92-4337-a202-1ac2dcdf77c7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:40.967241 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ebf7195d-db92-4337-a202-1ac2dcdf77c7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:40.967995 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ebf7195d-db92-4337-a202-1ac2dcdf77c7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:40.971250 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ebf7195d-db92-4337-a202-1ac2dcdf77c7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:40.976133 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ebf7195d-db92-4337-a202-1ac2dcdf77c7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:41.018999 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-5ba01de7-8bc6-4a65-a881-9364bc7562fa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.257061 Jan 18 20:23:41.022489 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 40/82] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:23:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 4264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 20:23:41.336560 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ebf7195d-db92-4337-a202-1ac2dcdf77c7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:41.368146 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ebf7195d-db92-4337-a202-1ac2dcdf77c7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1322 microversion: 2.1 time: 0.452049 Jan 18 20:23:41.383840 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 43/83] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:40 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1322 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:41.395009 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f0d8edec-f522-4938-b1eb-a77f2ccb0c71 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:41.396323 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f0d8edec-f522-4938-b1eb-a77f2ccb0c71 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:41.408472 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f0d8edec-f522-4938-b1eb-a77f2ccb0c71 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:41.409544 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f0d8edec-f522-4938-b1eb-a77f2ccb0c71 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:41.411321 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f0d8edec-f522-4938-b1eb-a77f2ccb0c71 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:41.412709 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f0d8edec-f522-4938-b1eb-a77f2ccb0c71 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:41.578745 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-043b3b76-9f2e-4fb0-ab73-87f9c99c8e23 req-dc694277-2413-4ae0-81d3-4555a131a2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712e0492-0709-4ab3-a1e2-5999b562d3fc", "tag": "775e3527-9a3d-4cae-a31c-6d0726c10e34"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:41.580645 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:23:41.580645 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:23:41.614022 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-043b3b76-9f2e-4fb0-ab73-87f9c99c8e23 req-dc694277-2413-4ae0-81d3-4555a131a2b6 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:41.617521 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-043b3b76-9f2e-4fb0-ab73-87f9c99c8e23 req-dc694277-2413-4ae0-81d3-4555a131a2b6 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:41.650832 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-043b3b76-9f2e-4fb0-ab73-87f9c99c8e23 req-dc694277-2413-4ae0-81d3-4555a131a2b6 service nova] Creating event network-changed:775e3527-9a3d-4cae-a31c-6d0726c10e34 for instance 712e0492-0709-4ab3-a1e2-5999b562d3fc on hv-cinder-82160 Jan 18 20:23:41.665204 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-043b3b76-9f2e-4fb0-ab73-87f9c99c8e23 req-dc694277-2413-4ae0-81d3-4555a131a2b6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.639213 Jan 18 20:23:41.695208 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 41/84] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:41.703346 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-6760dbe2-2333-469b-9c91-3dac6dbcea8c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:41.704804 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-6760dbe2-2333-469b-9c91-3dac6dbcea8c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:41.898008 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-6760dbe2-2333-469b-9c91-3dac6dbcea8c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:41.905861 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-6760dbe2-2333-469b-9c91-3dac6dbcea8c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1237 microversion: 2.1 time: 0.208972 Jan 18 20:23:41.911205 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 42/85] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:41 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1237 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:41.947238 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-43aff2c3-f73f-4ddb-a0ab-2ce4a5114b33 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1706129915", "imageRef": "c7d259ac-b206-430f-a3c0-794cee408236", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09a7462a-8def-4289-bb51-c535f8395ac3"}], "security_groups": [{"name": "tempest-securitygroup--441633718"}], "key_name": "tempest-keypair-748024130", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:42.162152 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f0d8edec-f522-4938-b1eb-a77f2ccb0c71 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:42.194483 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f0d8edec-f522-4938-b1eb-a77f2ccb0c71 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1314 microversion: 2.1 time: 0.801626 Jan 18 20:23:42.195648 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 44/86] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:41 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1314 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:42.220029 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-43273752-c9a1-45c6-ab06-55f761f0294c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:42.222560 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-43273752-c9a1-45c6-ab06-55f761f0294c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:42.242579 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-43273752-c9a1-45c6-ab06-55f761f0294c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:42.243832 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-43273752-c9a1-45c6-ab06-55f761f0294c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:42.246153 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-43273752-c9a1-45c6-ab06-55f761f0294c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:42.247324 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-43273752-c9a1-45c6-ab06-55f761f0294c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:42.408725 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.network.neutron [None req-43aff2c3-f73f-4ddb-a0ab-2ce4a5114b33 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] validate_networks() for [('09a7462a-8def-4289-bb51-c535f8395ac3', None, None, None, None, None)] {{(pid=116376) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:23:42.688773 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-43273752-c9a1-45c6-ab06-55f761f0294c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:42.708450 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-43273752-c9a1-45c6-ab06-55f761f0294c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1318 microversion: 2.1 time: 0.506626 Jan 18 20:23:42.724645 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 45/87] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:42 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:43.134704 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-9e54c6f8-37a3-4f3e-86af-a58fc12e6a37 req-80bfb9fd-d1d2-4efd-85c3-226fd7c2c44e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46334d7f-6fa1-41ba-bc9d-a80684750c70", "name": "network-vif-plugged", "status": "completed", "tag": "99714da3-e00f-44f4-9a6d-0775f70695dc"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:43.138030 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:23:43.138030 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:23:43.173570 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-9e54c6f8-37a3-4f3e-86af-a58fc12e6a37 req-80bfb9fd-d1d2-4efd-85c3-226fd7c2c44e service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:43.174604 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-9e54c6f8-37a3-4f3e-86af-a58fc12e6a37 req-80bfb9fd-d1d2-4efd-85c3-226fd7c2c44e service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:43.223576 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-9e54c6f8-37a3-4f3e-86af-a58fc12e6a37 req-80bfb9fd-d1d2-4efd-85c3-226fd7c2c44e service nova] Creating event network-vif-plugged:99714da3-e00f-44f4-9a6d-0775f70695dc for instance 46334d7f-6fa1-41ba-bc9d-a80684750c70 on hv-cinder-82160 Jan 18 20:23:43.246533 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-9e54c6f8-37a3-4f3e-86af-a58fc12e6a37 req-80bfb9fd-d1d2-4efd-85c3-226fd7c2c44e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.518644 Jan 18 20:23:43.253839 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 46/88] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:43.276113 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-99d0e5dc-add0-41ff-a216-dbf0ec809d4c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:43.279621 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-99d0e5dc-add0-41ff-a216-dbf0ec809d4c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:43.293060 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-99d0e5dc-add0-41ff-a216-dbf0ec809d4c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:43.293930 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-99d0e5dc-add0-41ff-a216-dbf0ec809d4c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:43.295576 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-99d0e5dc-add0-41ff-a216-dbf0ec809d4c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:43.297188 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-99d0e5dc-add0-41ff-a216-dbf0ec809d4c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:43.616962 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-99d0e5dc-add0-41ff-a216-dbf0ec809d4c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:43.634523 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-99d0e5dc-add0-41ff-a216-dbf0ec809d4c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1322 microversion: 2.1 time: 0.376864 Jan 18 20:23:43.644316 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 47/89] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:43 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:43.650251 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b17f33b1-958c-4496-907e-7658fb86e807 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:43.651749 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b17f33b1-958c-4496-907e-7658fb86e807 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:43.658957 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b17f33b1-958c-4496-907e-7658fb86e807 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:43.659890 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b17f33b1-958c-4496-907e-7658fb86e807 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:43.660984 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b17f33b1-958c-4496-907e-7658fb86e807 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:43.662689 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b17f33b1-958c-4496-907e-7658fb86e807 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:43.773856 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b17f33b1-958c-4496-907e-7658fb86e807 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:43.783634 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b17f33b1-958c-4496-907e-7658fb86e807 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1295 microversion: 2.1 time: 0.144614 Jan 18 20:23:43.784989 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 48/90] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:43 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1295 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:43.803352 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8efa0f9f-88b9-41a8-9792-5e9a0c7c2e5d tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:43.804223 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8efa0f9f-88b9-41a8-9792-5e9a0c7c2e5d tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:43.812445 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8efa0f9f-88b9-41a8-9792-5e9a0c7c2e5d tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:43.813168 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8efa0f9f-88b9-41a8-9792-5e9a0c7c2e5d tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:43.813993 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8efa0f9f-88b9-41a8-9792-5e9a0c7c2e5d tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:43.814716 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8efa0f9f-88b9-41a8-9792-5e9a0c7c2e5d tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:44.056761 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-43aff2c3-f73f-4ddb-a0ab-2ce4a5114b33 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Flavor limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:23:44.057507 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-43aff2c3-f73f-4ddb-a0ab-2ce4a5114b33 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Image limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:23:44.057894 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-43aff2c3-f73f-4ddb-a0ab-2ce4a5114b33 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Flavor pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:23:44.058410 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-43aff2c3-f73f-4ddb-a0ab-2ce4a5114b33 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Image pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:23:44.059009 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-43aff2c3-f73f-4ddb-a0ab-2ce4a5114b33 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:23:44.062573 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8efa0f9f-88b9-41a8-9792-5e9a0c7c2e5d tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:44.072083 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-43aff2c3-f73f-4ddb-a0ab-2ce4a5114b33 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:44.072859 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-43aff2c3-f73f-4ddb-a0ab-2ce4a5114b33 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:44.073572 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8efa0f9f-88b9-41a8-9792-5e9a0c7c2e5d tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1314 microversion: 2.1 time: 0.287040 Jan 18 20:23:44.073923 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-43aff2c3-f73f-4ddb-a0ab-2ce4a5114b33 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:44.074412 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 49/91] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:43 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:44.074602 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-43aff2c3-f73f-4ddb-a0ab-2ce4a5114b33 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:44.082012 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8c3dae93-e08e-4cce-b04a-7f139a4d07b6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:44.083072 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8c3dae93-e08e-4cce-b04a-7f139a4d07b6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:44.093455 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c3dae93-e08e-4cce-b04a-7f139a4d07b6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:44.094204 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c3dae93-e08e-4cce-b04a-7f139a4d07b6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:44.095700 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c3dae93-e08e-4cce-b04a-7f139a4d07b6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:44.096450 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c3dae93-e08e-4cce-b04a-7f139a4d07b6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:44.098308 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-43aff2c3-f73f-4ddb-a0ab-2ce4a5114b33 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Getting quotas for project 9d6dd542180144d480be34c9a555ae63. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:23:44.103462 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-43aff2c3-f73f-4ddb-a0ab-2ce4a5114b33 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Getting quotas for user b40e1486b9184e25b89c064fb56673df and project 9d6dd542180144d480be34c9a555ae63. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:23:44.119601 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-43aff2c3-f73f-4ddb-a0ab-2ce4a5114b33 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Going to run 1 instances... {{(pid=116376) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:23:44.124422 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-43aff2c3-f73f-4ddb-a0ab-2ce4a5114b33 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7d259ac-b206-430f-a3c0-794cee408236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116376) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:23:44.199360 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-43aff2c3-f73f-4ddb-a0ab-2ce4a5114b33 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.285593 Jan 18 20:23:44.200567 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 43/92] 10.222.0.67 () {62 vars in 1187 bytes} [Tue Jan 18 20:23:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 2288 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 18 20:23:44.211056 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-1f77ca36-bd2e-464b-8cd7-6fe6a1174fec tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:44.211983 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-1f77ca36-bd2e-464b-8cd7-6fe6a1174fec tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:44.313792 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-1f77ca36-bd2e-464b-8cd7-6fe6a1174fec tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:44.322542 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-1f77ca36-bd2e-464b-8cd7-6fe6a1174fec tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:44.324252 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-1f77ca36-bd2e-464b-8cd7-6fe6a1174fec tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:44.326283 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-1f77ca36-bd2e-464b-8cd7-6fe6a1174fec tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1281 microversion: 2.20 time: 0.118513 Jan 18 20:23:44.327463 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 44/93] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:23:44 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1281 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:23:44.332485 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8c3dae93-e08e-4cce-b04a-7f139a4d07b6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:44.341034 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8c3dae93-e08e-4cce-b04a-7f139a4d07b6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1318 microversion: 2.1 time: 0.265096 Jan 18 20:23:44.353366 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 50/94] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:44 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:44.654054 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-997acc20-97af-4a2b-b8ef-4b24d7e9410a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:44.654054 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-997acc20-97af-4a2b-b8ef-4b24d7e9410a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:44.668492 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-997acc20-97af-4a2b-b8ef-4b24d7e9410a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:44.669283 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-997acc20-97af-4a2b-b8ef-4b24d7e9410a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:44.674763 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-997acc20-97af-4a2b-b8ef-4b24d7e9410a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:44.683178 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-997acc20-97af-4a2b-b8ef-4b24d7e9410a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:44.809866 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-305de641-1bf6-41fd-8bd0-0935ab183f0d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:44.811941 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-305de641-1bf6-41fd-8bd0-0935ab183f0d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:44.830576 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-305de641-1bf6-41fd-8bd0-0935ab183f0d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:44.832631 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-305de641-1bf6-41fd-8bd0-0935ab183f0d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:44.835925 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-305de641-1bf6-41fd-8bd0-0935ab183f0d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:44.836443 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-305de641-1bf6-41fd-8bd0-0935ab183f0d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:44.991965 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-997acc20-97af-4a2b-b8ef-4b24d7e9410a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:45.012801 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-997acc20-97af-4a2b-b8ef-4b24d7e9410a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1322 microversion: 2.1 time: 0.363881 Jan 18 20:23:45.024697 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 45/95] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:44 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:45.048343 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-305de641-1bf6-41fd-8bd0-0935ab183f0d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:45.064063 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-305de641-1bf6-41fd-8bd0-0935ab183f0d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1295 microversion: 2.1 time: 0.257624 Jan 18 20:23:45.066164 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 51/96] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:44 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1295 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:45.102621 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-bfa63c9f-50e9-4cc8-8cda-187ec9a35425 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:45.103325 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-bfa63c9f-50e9-4cc8-8cda-187ec9a35425 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:45.116564 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bfa63c9f-50e9-4cc8-8cda-187ec9a35425 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:45.117516 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bfa63c9f-50e9-4cc8-8cda-187ec9a35425 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:45.127458 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bfa63c9f-50e9-4cc8-8cda-187ec9a35425 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:45.127458 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bfa63c9f-50e9-4cc8-8cda-187ec9a35425 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:45.272144 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-5c4d1114-fb87-44fe-a635-ad3441dddaf0 req-b99545b5-e76b-4147-89da-17337c9ec9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2962a0f0-ce3a-4351-84d7-f3155f5bd129", "name": "network-vif-plugged", "status": "completed", "tag": "606d225c-d6f1-491e-8ba1-c66d52808c4b"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:45.274451 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:23:45.274451 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:23:45.294873 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-5c4d1114-fb87-44fe-a635-ad3441dddaf0 req-b99545b5-e76b-4147-89da-17337c9ec9d3 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:45.295527 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-5c4d1114-fb87-44fe-a635-ad3441dddaf0 req-b99545b5-e76b-4147-89da-17337c9ec9d3 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:45.324923 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-5c4d1114-fb87-44fe-a635-ad3441dddaf0 req-b99545b5-e76b-4147-89da-17337c9ec9d3 service nova] Creating event network-vif-plugged:606d225c-d6f1-491e-8ba1-c66d52808c4b for instance 2962a0f0-ce3a-4351-84d7-f3155f5bd129 on hv-cinder-82160 Jan 18 20:23:45.335146 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-5c4d1114-fb87-44fe-a635-ad3441dddaf0 req-b99545b5-e76b-4147-89da-17337c9ec9d3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068521 Jan 18 20:23:45.339569 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 52/97] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:45.352070 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0860251d-e111-4ac3-a80f-9647378a33b5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:45.355362 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0860251d-e111-4ac3-a80f-9647378a33b5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:45.371380 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0860251d-e111-4ac3-a80f-9647378a33b5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:45.373588 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0860251d-e111-4ac3-a80f-9647378a33b5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:45.374963 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0860251d-e111-4ac3-a80f-9647378a33b5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:45.378016 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0860251d-e111-4ac3-a80f-9647378a33b5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:45.531987 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0860251d-e111-4ac3-a80f-9647378a33b5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:45.543433 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0860251d-e111-4ac3-a80f-9647378a33b5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:45.548341 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0860251d-e111-4ac3-a80f-9647378a33b5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:45.557724 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0860251d-e111-4ac3-a80f-9647378a33b5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1333 microversion: 2.20 time: 0.209437 Jan 18 20:23:45.559151 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 53/98] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:23:45 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1333 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:23:45.574873 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a2a6a334-b713-4024-898f-0c9b58a5ff6f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:45.575804 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a2a6a334-b713-4024-898f-0c9b58a5ff6f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:45.592054 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a2a6a334-b713-4024-898f-0c9b58a5ff6f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:45.592817 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a2a6a334-b713-4024-898f-0c9b58a5ff6f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:45.593827 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a2a6a334-b713-4024-898f-0c9b58a5ff6f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:45.594432 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a2a6a334-b713-4024-898f-0c9b58a5ff6f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:45.642780 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-bfa63c9f-50e9-4cc8-8cda-187ec9a35425 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:45.654427 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-bfa63c9f-50e9-4cc8-8cda-187ec9a35425 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1314 microversion: 2.1 time: 0.553855 Jan 18 20:23:45.655274 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 46/99] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:45 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:45.888144 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a2a6a334-b713-4024-898f-0c9b58a5ff6f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:45.900359 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a2a6a334-b713-4024-898f-0c9b58a5ff6f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1318 microversion: 2.1 time: 0.339587 Jan 18 20:23:45.901848 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 54/100] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:45 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:46.037495 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ca488e49-1899-46cb-9900-7a7f5d68e908 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:46.040273 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ca488e49-1899-46cb-9900-7a7f5d68e908 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:46.070957 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ca488e49-1899-46cb-9900-7a7f5d68e908 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:46.072178 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ca488e49-1899-46cb-9900-7a7f5d68e908 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:46.074126 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ca488e49-1899-46cb-9900-7a7f5d68e908 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:46.075569 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ca488e49-1899-46cb-9900-7a7f5d68e908 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:46.081002 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-164dea87-6cb8-43c6-9ac7-c929f6fcdda6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:46.081771 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-164dea87-6cb8-43c6-9ac7-c929f6fcdda6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:46.102162 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-164dea87-6cb8-43c6-9ac7-c929f6fcdda6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:46.105076 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-164dea87-6cb8-43c6-9ac7-c929f6fcdda6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:46.111984 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-164dea87-6cb8-43c6-9ac7-c929f6fcdda6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:46.112872 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-164dea87-6cb8-43c6-9ac7-c929f6fcdda6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:46.784237 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-164dea87-6cb8-43c6-9ac7-c929f6fcdda6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:46.797383 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-164dea87-6cb8-43c6-9ac7-c929f6fcdda6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1362 microversion: 2.1 time: 0.720421 Jan 18 20:23:46.798333 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 55/101] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:46 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1362 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:46.804297 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-541fe264-fffd-4c5d-a149-e49f5785ad10 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:46.814489 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-541fe264-fffd-4c5d-a149-e49f5785ad10 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:46.824592 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-541fe264-fffd-4c5d-a149-e49f5785ad10 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:46.825079 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-541fe264-fffd-4c5d-a149-e49f5785ad10 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:46.825877 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-541fe264-fffd-4c5d-a149-e49f5785ad10 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:46.826275 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-541fe264-fffd-4c5d-a149-e49f5785ad10 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:46.959601 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-541fe264-fffd-4c5d-a149-e49f5785ad10 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:46.969419 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-ca488e49-1899-46cb-9900-7a7f5d68e908 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:46.977129 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-541fe264-fffd-4c5d-a149-e49f5785ad10 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:46.978747 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-541fe264-fffd-4c5d-a149-e49f5785ad10 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:46.983667 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ca488e49-1899-46cb-9900-7a7f5d68e908 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1322 microversion: 2.1 time: 0.954140 Jan 18 20:23:46.984595 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 47/102] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:46 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1322 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:46.989164 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7df01801-87c0-41de-b8f3-c716dfe7e278 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:46.990352 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-7df01801-87c0-41de-b8f3-c716dfe7e278 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:46.991656 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-541fe264-fffd-4c5d-a149-e49f5785ad10 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1339 microversion: 2.20 time: 0.191808 Jan 18 20:23:46.995428 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 56/103] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:23:46 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1339 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:23:47.009067 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-19a3d99e-83b2-4747-8b64-58e41add138d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:47.013040 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-19a3d99e-83b2-4747-8b64-58e41add138d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:47.028294 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7df01801-87c0-41de-b8f3-c716dfe7e278 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:47.031961 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7df01801-87c0-41de-b8f3-c716dfe7e278 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:47.033135 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7df01801-87c0-41de-b8f3-c716dfe7e278 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:47.033518 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7df01801-87c0-41de-b8f3-c716dfe7e278 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:47.044438 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-19a3d99e-83b2-4747-8b64-58e41add138d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:47.044986 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-19a3d99e-83b2-4747-8b64-58e41add138d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:47.045963 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-19a3d99e-83b2-4747-8b64-58e41add138d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:47.046406 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-19a3d99e-83b2-4747-8b64-58e41add138d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:47.392750 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-19a3d99e-83b2-4747-8b64-58e41add138d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:47.403534 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-19a3d99e-83b2-4747-8b64-58e41add138d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1507 microversion: 2.1 time: 0.406656 Jan 18 20:23:47.405447 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 57/104] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:46 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1507 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:47.417467 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-6bf3c0d4-aad0-44a4-a939-64b85d0e6505 req-7269e748-3c1e-449b-ab56-8f82b6acb30a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6e08025-ad66-4921-8672-ab55c85cbfb4", "tag": "df2b9969-bf44-42c9-86a4-02ad9e3ae1d7"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:47.436156 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:23:47.436156 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:23:47.457693 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-6bf3c0d4-aad0-44a4-a939-64b85d0e6505 req-7269e748-3c1e-449b-ab56-8f82b6acb30a service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:47.458931 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-6bf3c0d4-aad0-44a4-a939-64b85d0e6505 req-7269e748-3c1e-449b-ab56-8f82b6acb30a service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:47.487366 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-6bf3c0d4-aad0-44a4-a939-64b85d0e6505 req-7269e748-3c1e-449b-ab56-8f82b6acb30a service nova] Creating event network-changed:df2b9969-bf44-42c9-86a4-02ad9e3ae1d7 for instance b6e08025-ad66-4921-8672-ab55c85cbfb4 on hv-cinder-82160 Jan 18 20:23:47.504387 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-6bf3c0d4-aad0-44a4-a939-64b85d0e6505 req-7269e748-3c1e-449b-ab56-8f82b6acb30a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090413 Jan 18 20:23:47.506923 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 58/105] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:47.552868 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-7df01801-87c0-41de-b8f3-c716dfe7e278 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:47.566001 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7df01801-87c0-41de-b8f3-c716dfe7e278 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1314 microversion: 2.1 time: 0.580302 Jan 18 20:23:47.567066 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 48/106] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:46 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:47.819591 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ac52dac4-e641-41aa-8f5c-ef74e6891be5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:47.822683 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ac52dac4-e641-41aa-8f5c-ef74e6891be5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:47.831286 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ac52dac4-e641-41aa-8f5c-ef74e6891be5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:47.832055 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ac52dac4-e641-41aa-8f5c-ef74e6891be5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:47.834528 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ac52dac4-e641-41aa-8f5c-ef74e6891be5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:47.835212 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ac52dac4-e641-41aa-8f5c-ef74e6891be5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:48.019806 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d2612a17-fc33-44d4-84f7-ee4aac814dd0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:48.023522 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d2612a17-fc33-44d4-84f7-ee4aac814dd0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:48.054390 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d2612a17-fc33-44d4-84f7-ee4aac814dd0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:48.059188 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d2612a17-fc33-44d4-84f7-ee4aac814dd0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:48.064785 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d2612a17-fc33-44d4-84f7-ee4aac814dd0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:48.065933 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d2612a17-fc33-44d4-84f7-ee4aac814dd0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:48.433785 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d2612a17-fc33-44d4-84f7-ee4aac814dd0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:48.443714 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d2612a17-fc33-44d4-84f7-ee4aac814dd0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:48.449322 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d2612a17-fc33-44d4-84f7-ee4aac814dd0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:48.458965 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d2612a17-fc33-44d4-84f7-ee4aac814dd0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1406 microversion: 2.20 time: 0.445736 Jan 18 20:23:48.461355 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 49/107] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:23:48 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1406 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:23:48.473020 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-979cb8ce-f052-419d-8307-44d377f4ded5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:48.475647 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-979cb8ce-f052-419d-8307-44d377f4ded5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:48.491885 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-979cb8ce-f052-419d-8307-44d377f4ded5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:48.493568 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-979cb8ce-f052-419d-8307-44d377f4ded5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:48.495436 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-979cb8ce-f052-419d-8307-44d377f4ded5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:48.496285 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-979cb8ce-f052-419d-8307-44d377f4ded5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:48.614887 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ac52dac4-e641-41aa-8f5c-ef74e6891be5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:48.634268 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ac52dac4-e641-41aa-8f5c-ef74e6891be5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1362 microversion: 2.1 time: 0.820672 Jan 18 20:23:48.634756 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 59/108] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:47 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1362 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:48.655114 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a3b3b01a-771c-432a-9559-5a45ca1d45c3 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:48.656087 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a3b3b01a-771c-432a-9559-5a45ca1d45c3 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:48.663774 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3b3b01a-771c-432a-9559-5a45ca1d45c3 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:48.664515 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3b3b01a-771c-432a-9559-5a45ca1d45c3 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:48.665603 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3b3b01a-771c-432a-9559-5a45ca1d45c3 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:48.666278 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3b3b01a-771c-432a-9559-5a45ca1d45c3 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:48.904238 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-979cb8ce-f052-419d-8307-44d377f4ded5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:48.952242 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-979cb8ce-f052-419d-8307-44d377f4ded5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1322 microversion: 2.1 time: 0.488347 Jan 18 20:23:48.953284 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 50/109] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:48 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1322 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:49.162463 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fc61b63f-6abd-416c-85ad-b2f3a7d7f350 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e203a156-1197-49d2-8e91-6052c655106a"}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:49.164578 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-fc61b63f-6abd-416c-85ad-b2f3a7d7f350 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:49.178066 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fc61b63f-6abd-416c-85ad-b2f3a7d7f350 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:49.184938 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fc61b63f-6abd-416c-85ad-b2f3a7d7f350 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:49.188158 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fc61b63f-6abd-416c-85ad-b2f3a7d7f350 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:49.192154 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fc61b63f-6abd-416c-85ad-b2f3a7d7f350 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:49.199919 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a3b3b01a-771c-432a-9559-5a45ca1d45c3 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:49.213768 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a3b3b01a-771c-432a-9559-5a45ca1d45c3 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1501 microversion: 2.1 time: 0.565779 Jan 18 20:23:49.214595 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 60/110] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:48 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1501 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:49.219617 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-49511e98-28fb-4551-89ae-62274b372c9e req-7945763f-04f4-4858-b36c-61079ed6793b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6", "name": "network-vif-plugged", "status": "completed", "tag": "81368d94-6b86-4c1a-84ec-fc21d1647ac5"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:49.230638 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:23:49.230638 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:23:49.247986 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-49511e98-28fb-4551-89ae-62274b372c9e req-7945763f-04f4-4858-b36c-61079ed6793b service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:49.248784 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-49511e98-28fb-4551-89ae-62274b372c9e req-7945763f-04f4-4858-b36c-61079ed6793b service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:49.295738 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-49511e98-28fb-4551-89ae-62274b372c9e req-7945763f-04f4-4858-b36c-61079ed6793b service nova] Creating event network-vif-plugged:81368d94-6b86-4c1a-84ec-fc21d1647ac5 for instance 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 on hv-cinder-82160 Jan 18 20:23:49.308945 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-49511e98-28fb-4551-89ae-62274b372c9e req-7945763f-04f4-4858-b36c-61079ed6793b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092715 Jan 18 20:23:49.309978 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 61/111] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:49.480040 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-858a86ed-158f-464d-9def-8153ee328bd5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:49.480930 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-858a86ed-158f-464d-9def-8153ee328bd5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:49.497978 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-858a86ed-158f-464d-9def-8153ee328bd5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:49.497978 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-858a86ed-158f-464d-9def-8153ee328bd5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:49.499010 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-858a86ed-158f-464d-9def-8153ee328bd5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:49.499494 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-858a86ed-158f-464d-9def-8153ee328bd5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:50.237402 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-fc61b63f-6abd-416c-85ad-b2f3a7d7f350 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "POST /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.080873 Jan 18 20:23:50.238451 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 51/112] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Jan 18 20:23:49 2022] POST /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70/os-volume_attachments => generated 194 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:23:50.259821 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a0b5acb9-55f7-4ea3-aa0e-0292036e7396 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:50.273825 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-a0b5acb9-55f7-4ea3-aa0e-0292036e7396 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:50.309356 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a0b5acb9-55f7-4ea3-aa0e-0292036e7396 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:50.310622 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a0b5acb9-55f7-4ea3-aa0e-0292036e7396 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:50.312310 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a0b5acb9-55f7-4ea3-aa0e-0292036e7396 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:50.313152 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a0b5acb9-55f7-4ea3-aa0e-0292036e7396 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:50.325364 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-858a86ed-158f-464d-9def-8153ee328bd5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:50.348577 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-858a86ed-158f-464d-9def-8153ee328bd5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:50.371698 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-858a86ed-158f-464d-9def-8153ee328bd5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:50.374663 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-858a86ed-158f-464d-9def-8153ee328bd5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1406 microversion: 2.20 time: 0.898740 Jan 18 20:23:50.384822 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 62/113] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:23:49 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1406 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:23:50.409918 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-34b51a38-410b-4722-b019-56de8d562344 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:50.414724 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-34b51a38-410b-4722-b019-56de8d562344 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:50.453411 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-34b51a38-410b-4722-b019-56de8d562344 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:50.456978 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-34b51a38-410b-4722-b019-56de8d562344 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:50.459783 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-34b51a38-410b-4722-b019-56de8d562344 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:50.461189 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-34b51a38-410b-4722-b019-56de8d562344 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:50.867843 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-34b51a38-410b-4722-b019-56de8d562344 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:50.883659 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-34b51a38-410b-4722-b019-56de8d562344 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1322 microversion: 2.1 time: 0.485097 Jan 18 20:23:50.887166 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 63/114] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:50 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1322 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:50.909539 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-8a662033-faf4-4072-9d1e-054e3e6d6cab req-732a62e3-40ff-4acf-9c13-45a4d5e0f8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54f16911-8813-49b1-a940-9d83c6a5b131", "tag": "555e1e24-9775-40bc-b590-9ec8763d4dd0"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:50.912076 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:23:50.912076 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:23:50.948535 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-8a662033-faf4-4072-9d1e-054e3e6d6cab req-732a62e3-40ff-4acf-9c13-45a4d5e0f8c2 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:50.950366 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-8a662033-faf4-4072-9d1e-054e3e6d6cab req-732a62e3-40ff-4acf-9c13-45a4d5e0f8c2 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:50.999834 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-8a662033-faf4-4072-9d1e-054e3e6d6cab req-732a62e3-40ff-4acf-9c13-45a4d5e0f8c2 service nova] Creating event network-changed:555e1e24-9775-40bc-b590-9ec8763d4dd0 for instance 54f16911-8813-49b1-a940-9d83c6a5b131 on hv-cinder-82160 Jan 18 20:23:51.013370 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-8a662033-faf4-4072-9d1e-054e3e6d6cab req-732a62e3-40ff-4acf-9c13-45a4d5e0f8c2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122273 Jan 18 20:23:51.014152 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 64/115] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:51.097787 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-78dd0f96-07da-430d-a057-ba759cac86a1 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbbec356-e0e4-4c94-baf2-db2567edad4c"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:51.100556 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-78dd0f96-07da-430d-a057-ba759cac86a1 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:51.105783 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a0b5acb9-55f7-4ea3-aa0e-0292036e7396 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:51.116899 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-78dd0f96-07da-430d-a057-ba759cac86a1 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:51.118114 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-78dd0f96-07da-430d-a057-ba759cac86a1 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:51.120192 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-78dd0f96-07da-430d-a057-ba759cac86a1 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:51.121524 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-78dd0f96-07da-430d-a057-ba759cac86a1 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:51.121772 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a0b5acb9-55f7-4ea3-aa0e-0292036e7396 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1362 microversion: 2.1 time: 0.880618 Jan 18 20:23:51.136598 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 52/116] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:50 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1362 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:51.407506 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-cc8f920f-fbc0-4c3c-bfae-728006540589 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:51.408609 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-cc8f920f-fbc0-4c3c-bfae-728006540589 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:51.448378 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cc8f920f-fbc0-4c3c-bfae-728006540589 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:51.449109 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cc8f920f-fbc0-4c3c-bfae-728006540589 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:51.450090 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cc8f920f-fbc0-4c3c-bfae-728006540589 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:51.450688 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cc8f920f-fbc0-4c3c-bfae-728006540589 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:51.672199 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-cc8f920f-fbc0-4c3c-bfae-728006540589 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:51.672837 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-cc8f920f-fbc0-4c3c-bfae-728006540589 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:51.675487 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-cc8f920f-fbc0-4c3c-bfae-728006540589 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:51.677759 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-cc8f920f-fbc0-4c3c-bfae-728006540589 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1406 microversion: 2.20 time: 0.278225 Jan 18 20:23:51.689167 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 53/117] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:23:51 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:23:51.707103 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-42333e41-926e-4a2e-b2df-7ccc03f3b2e3 req-9860fb57-582f-4de0-9e1b-84b7d863b6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712e0492-0709-4ab3-a1e2-5999b562d3fc", "name": "network-vif-plugged", "status": "completed", "tag": "775e3527-9a3d-4cae-a31c-6d0726c10e34"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:51.708896 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:23:51.708896 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:23:51.742918 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-42333e41-926e-4a2e-b2df-7ccc03f3b2e3 req-9860fb57-582f-4de0-9e1b-84b7d863b6b0 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:51.746154 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-42333e41-926e-4a2e-b2df-7ccc03f3b2e3 req-9860fb57-582f-4de0-9e1b-84b7d863b6b0 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:51.797786 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-42333e41-926e-4a2e-b2df-7ccc03f3b2e3 req-9860fb57-582f-4de0-9e1b-84b7d863b6b0 service nova] Creating event network-vif-plugged:775e3527-9a3d-4cae-a31c-6d0726c10e34 for instance 712e0492-0709-4ab3-a1e2-5999b562d3fc on hv-cinder-82160 Jan 18 20:23:51.827175 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-42333e41-926e-4a2e-b2df-7ccc03f3b2e3 req-9860fb57-582f-4de0-9e1b-84b7d863b6b0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123586 Jan 18 20:23:51.828401 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 54/118] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:51.915173 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-dcc2667c-85cc-4cdd-98b9-9cf1e79e1cd2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:51.916133 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-dcc2667c-85cc-4cdd-98b9-9cf1e79e1cd2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:51.937311 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dcc2667c-85cc-4cdd-98b9-9cf1e79e1cd2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:51.937768 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dcc2667c-85cc-4cdd-98b9-9cf1e79e1cd2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:51.940828 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dcc2667c-85cc-4cdd-98b9-9cf1e79e1cd2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:51.941274 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dcc2667c-85cc-4cdd-98b9-9cf1e79e1cd2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:52.047651 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-78dd0f96-07da-430d-a057-ba759cac86a1 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "POST /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.959545 Jan 18 20:23:52.049628 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 65/119] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Jan 18 20:23:51 2022] POST /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129/os-volume_attachments => generated 194 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:52.152836 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e60da3d3-234a-4f56-ae21-6cb3d38e1437 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:52.159891 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e60da3d3-234a-4f56-ae21-6cb3d38e1437 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:52.187393 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e60da3d3-234a-4f56-ae21-6cb3d38e1437 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:52.188424 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e60da3d3-234a-4f56-ae21-6cb3d38e1437 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:52.190960 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e60da3d3-234a-4f56-ae21-6cb3d38e1437 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:52.192728 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e60da3d3-234a-4f56-ae21-6cb3d38e1437 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:52.399003 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-dcc2667c-85cc-4cdd-98b9-9cf1e79e1cd2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:52.410941 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-dcc2667c-85cc-4cdd-98b9-9cf1e79e1cd2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1322 microversion: 2.1 time: 0.497320 Jan 18 20:23:52.412216 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 55/120] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:51 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1322 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:52.562841 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e60da3d3-234a-4f56-ae21-6cb3d38e1437 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:52.574875 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e60da3d3-234a-4f56-ae21-6cb3d38e1437 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1362 microversion: 2.1 time: 0.429356 Jan 18 20:23:52.576190 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 66/121] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:52 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1362 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:52.697211 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-950b59fd-ba8c-4e75-b26b-b371eb31bd86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:52.698203 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-950b59fd-ba8c-4e75-b26b-b371eb31bd86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:52.712348 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-950b59fd-ba8c-4e75-b26b-b371eb31bd86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:52.713051 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-950b59fd-ba8c-4e75-b26b-b371eb31bd86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:52.714071 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-950b59fd-ba8c-4e75-b26b-b371eb31bd86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:52.715656 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-950b59fd-ba8c-4e75-b26b-b371eb31bd86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:52.970858 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-950b59fd-ba8c-4e75-b26b-b371eb31bd86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:52.980384 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-950b59fd-ba8c-4e75-b26b-b371eb31bd86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:52.984458 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-950b59fd-ba8c-4e75-b26b-b371eb31bd86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:52.986271 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-950b59fd-ba8c-4e75-b26b-b371eb31bd86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1406 microversion: 2.20 time: 0.293690 Jan 18 20:23:52.998338 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 56/122] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:23:52 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:23:53.439387 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-27d0d2c1-2a65-45d2-80c5-18eedddabdf9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:53.440564 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-27d0d2c1-2a65-45d2-80c5-18eedddabdf9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:53.451884 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-27d0d2c1-2a65-45d2-80c5-18eedddabdf9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:53.452640 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-27d0d2c1-2a65-45d2-80c5-18eedddabdf9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:53.453990 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-27d0d2c1-2a65-45d2-80c5-18eedddabdf9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:53.454722 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-27d0d2c1-2a65-45d2-80c5-18eedddabdf9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:53.610105 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-db7d5daf-872a-42e1-a031-8dd15c081bb6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:53.612616 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-db7d5daf-872a-42e1-a031-8dd15c081bb6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:53.625420 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-db7d5daf-872a-42e1-a031-8dd15c081bb6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:53.627518 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-db7d5daf-872a-42e1-a031-8dd15c081bb6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:53.629548 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-db7d5daf-872a-42e1-a031-8dd15c081bb6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:53.630913 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-db7d5daf-872a-42e1-a031-8dd15c081bb6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:53.669121 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-27d0d2c1-2a65-45d2-80c5-18eedddabdf9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:53.688360 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-27d0d2c1-2a65-45d2-80c5-18eedddabdf9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1515 microversion: 2.1 time: 0.253922 Jan 18 20:23:53.689565 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 67/123] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:53 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:53.721421 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f5065b85-0230-4001-87dc-01f0e1edd8bd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:53.724367 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f5065b85-0230-4001-87dc-01f0e1edd8bd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:53.735659 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f5065b85-0230-4001-87dc-01f0e1edd8bd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:53.736872 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f5065b85-0230-4001-87dc-01f0e1edd8bd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:53.738597 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f5065b85-0230-4001-87dc-01f0e1edd8bd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:53.740305 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f5065b85-0230-4001-87dc-01f0e1edd8bd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:53.821737 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-f5065b85-0230-4001-87dc-01f0e1edd8bd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lazy-loading 'flavor' on Instance uuid 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:23:53.903860 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-db7d5daf-872a-42e1-a031-8dd15c081bb6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:53.942548 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-db7d5daf-872a-42e1-a031-8dd15c081bb6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1362 microversion: 2.1 time: 0.341248 Jan 18 20:23:53.945027 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 57/124] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:53 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:53.967554 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-982748c3-cc30-4b4c-a741-bb894674ab1a req-e270b305-99dd-416c-a6c7-9ad5e34cd0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6e08025-ad66-4921-8672-ab55c85cbfb4", "name": "network-vif-plugged", "status": "completed", "tag": "df2b9969-bf44-42c9-86a4-02ad9e3ae1d7"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:53.972174 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:23:53.972174 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:23:53.989894 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-982748c3-cc30-4b4c-a741-bb894674ab1a req-e270b305-99dd-416c-a6c7-9ad5e34cd0ac service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:53.990984 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-982748c3-cc30-4b4c-a741-bb894674ab1a req-e270b305-99dd-416c-a6c7-9ad5e34cd0ac service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:54.014473 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-982748c3-cc30-4b4c-a741-bb894674ab1a req-e270b305-99dd-416c-a6c7-9ad5e34cd0ac service nova] Creating event network-vif-plugged:df2b9969-bf44-42c9-86a4-02ad9e3ae1d7 for instance b6e08025-ad66-4921-8672-ab55c85cbfb4 on hv-cinder-82160 Jan 18 20:23:54.032636 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-982748c3-cc30-4b4c-a741-bb894674ab1a req-e270b305-99dd-416c-a6c7-9ad5e34cd0ac service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084071 Jan 18 20:23:54.034318 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 58/125] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:23:54.054940 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-9aad4e4e-a122-43e1-ac0e-cf49e60d8a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:54.057053 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-9aad4e4e-a122-43e1-ac0e-cf49e60d8a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:54.083876 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9aad4e4e-a122-43e1-ac0e-cf49e60d8a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:54.085996 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9aad4e4e-a122-43e1-ac0e-cf49e60d8a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:54.088194 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9aad4e4e-a122-43e1-ac0e-cf49e60d8a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:54.089012 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9aad4e4e-a122-43e1-ac0e-cf49e60d8a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:54.195606 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f5065b85-0230-4001-87dc-01f0e1edd8bd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "POST /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6/action" status: 200 len: 32 microversion: 2.1 time: 0.480752 Jan 18 20:23:54.211178 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 68/126] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:23:53 2022] POST /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6/action => generated 32 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 18 20:23:54.225167 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-44cdcc87-8923-40a0-8fcd-f48ebcb79820 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:54.232412 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-44cdcc87-8923-40a0-8fcd-f48ebcb79820 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:54.264909 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-44cdcc87-8923-40a0-8fcd-f48ebcb79820 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:54.265303 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-44cdcc87-8923-40a0-8fcd-f48ebcb79820 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:54.267588 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-44cdcc87-8923-40a0-8fcd-f48ebcb79820 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:54.269325 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-44cdcc87-8923-40a0-8fcd-f48ebcb79820 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:54.459165 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-9aad4e4e-a122-43e1-ac0e-cf49e60d8a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:54.470773 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-9aad4e4e-a122-43e1-ac0e-cf49e60d8a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:54.472653 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-9aad4e4e-a122-43e1-ac0e-cf49e60d8a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:54.473886 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-9aad4e4e-a122-43e1-ac0e-cf49e60d8a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1406 microversion: 2.20 time: 0.436689 Jan 18 20:23:54.474620 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 59/127] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:23:54 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1406 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:23:54.976775 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-cfa0f83b-cf08-4afe-a379-26452ed32ad1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:54.978564 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-cfa0f83b-cf08-4afe-a379-26452ed32ad1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:54.987781 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cfa0f83b-cf08-4afe-a379-26452ed32ad1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:54.988720 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cfa0f83b-cf08-4afe-a379-26452ed32ad1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:54.990770 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cfa0f83b-cf08-4afe-a379-26452ed32ad1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:54.991809 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cfa0f83b-cf08-4afe-a379-26452ed32ad1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:55.140358 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-44cdcc87-8923-40a0-8fcd-f48ebcb79820 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:55.168297 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-44cdcc87-8923-40a0-8fcd-f48ebcb79820 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.951365 Jan 18 20:23:55.172752 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 69/128] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:54 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:55.277047 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-cfa0f83b-cf08-4afe-a379-26452ed32ad1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:55.289342 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-cfa0f83b-cf08-4afe-a379-26452ed32ad1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1362 microversion: 2.1 time: 0.316460 Jan 18 20:23:55.290064 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 60/129] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:54 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:55.498410 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-38af8768-9c72-4f6c-8336-c186ad14e457 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:55.502961 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-38af8768-9c72-4f6c-8336-c186ad14e457 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:55.530156 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-38af8768-9c72-4f6c-8336-c186ad14e457 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:55.530985 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-38af8768-9c72-4f6c-8336-c186ad14e457 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:55.536355 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-38af8768-9c72-4f6c-8336-c186ad14e457 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:55.536852 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-38af8768-9c72-4f6c-8336-c186ad14e457 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:55.991621 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-38af8768-9c72-4f6c-8336-c186ad14e457 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:56.007441 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-38af8768-9c72-4f6c-8336-c186ad14e457 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:56.009212 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-38af8768-9c72-4f6c-8336-c186ad14e457 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:56.010372 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-38af8768-9c72-4f6c-8336-c186ad14e457 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1406 microversion: 2.20 time: 0.521173 Jan 18 20:23:56.011287 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 70/130] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:23:55 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1406 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:23:56.203823 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ff428fa9-446a-4619-a986-f66e93b78065 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:56.210161 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ff428fa9-446a-4619-a986-f66e93b78065 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:56.253541 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ff428fa9-446a-4619-a986-f66e93b78065 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:56.257585 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ff428fa9-446a-4619-a986-f66e93b78065 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:56.258946 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ff428fa9-446a-4619-a986-f66e93b78065 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:56.259721 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ff428fa9-446a-4619-a986-f66e93b78065 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:56.319151 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3610f3af-a11c-4802-b2e9-ca67c16460ee tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:56.320275 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3610f3af-a11c-4802-b2e9-ca67c16460ee tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:56.337053 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3610f3af-a11c-4802-b2e9-ca67c16460ee tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:56.338415 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3610f3af-a11c-4802-b2e9-ca67c16460ee tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:56.340622 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3610f3af-a11c-4802-b2e9-ca67c16460ee tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:56.341632 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3610f3af-a11c-4802-b2e9-ca67c16460ee tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:56.634347 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-ff428fa9-446a-4619-a986-f66e93b78065 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:56.652265 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ff428fa9-446a-4619-a986-f66e93b78065 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.456167 Jan 18 20:23:56.668392 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 61/131] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:56 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:56.701770 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3610f3af-a11c-4802-b2e9-ca67c16460ee tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:56.715992 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3610f3af-a11c-4802-b2e9-ca67c16460ee tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1547 microversion: 2.1 time: 0.403178 Jan 18 20:23:56.728145 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 71/132] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:56 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1547 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:23:56.751597 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-07996714-8582-4eb3-980a-a59e8a0e78b5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:56.752486 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-07996714-8582-4eb3-980a-a59e8a0e78b5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:56.763501 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-07996714-8582-4eb3-980a-a59e8a0e78b5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:56.764791 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-07996714-8582-4eb3-980a-a59e8a0e78b5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:56.767078 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-07996714-8582-4eb3-980a-a59e8a0e78b5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:56.768260 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-07996714-8582-4eb3-980a-a59e8a0e78b5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:56.928318 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-07996714-8582-4eb3-980a-a59e8a0e78b5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.183126 Jan 18 20:23:56.930466 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 62/133] 10.222.0.67 () {58 vars in 1274 bytes} [Tue Jan 18 20:23:56 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:23:57.031307 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1cb04d52-71b6-4678-af6c-767500beea86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:57.032462 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1cb04d52-71b6-4678-af6c-767500beea86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:57.044670 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1cb04d52-71b6-4678-af6c-767500beea86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:57.045381 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1cb04d52-71b6-4678-af6c-767500beea86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:57.059381 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1cb04d52-71b6-4678-af6c-767500beea86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:57.059823 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1cb04d52-71b6-4678-af6c-767500beea86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:57.170843 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-ea13d55a-624c-445c-804a-47eeebe1c764 req-88ec1669-6bd6-47f8-8318-c2d64d1353d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54f16911-8813-49b1-a940-9d83c6a5b131", "name": "network-vif-plugged", "status": "completed", "tag": "555e1e24-9775-40bc-b590-9ec8763d4dd0"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:57.179232 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:23:57.179232 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:23:57.200778 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-ea13d55a-624c-445c-804a-47eeebe1c764 req-88ec1669-6bd6-47f8-8318-c2d64d1353d1 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:57.201535 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-ea13d55a-624c-445c-804a-47eeebe1c764 req-88ec1669-6bd6-47f8-8318-c2d64d1353d1 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:57.235470 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-ea13d55a-624c-445c-804a-47eeebe1c764 req-88ec1669-6bd6-47f8-8318-c2d64d1353d1 service nova] Creating event network-vif-plugged:555e1e24-9775-40bc-b590-9ec8763d4dd0 for instance 54f16911-8813-49b1-a940-9d83c6a5b131 on hv-cinder-82160 Jan 18 20:23:57.246176 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-ea13d55a-624c-445c-804a-47eeebe1c764 req-88ec1669-6bd6-47f8-8318-c2d64d1353d1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083906 Jan 18 20:23:57.247664 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 63/134] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:23:57.695220 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-25f9bf49-4c56-4aef-a59a-692bffcbd8e7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:57.699683 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-25f9bf49-4c56-4aef-a59a-692bffcbd8e7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:57.724775 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-25f9bf49-4c56-4aef-a59a-692bffcbd8e7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:57.726063 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-25f9bf49-4c56-4aef-a59a-692bffcbd8e7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:57.728128 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-25f9bf49-4c56-4aef-a59a-692bffcbd8e7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:57.729455 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-25f9bf49-4c56-4aef-a59a-692bffcbd8e7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:57.834675 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1cb04d52-71b6-4678-af6c-767500beea86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:57.845378 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1cb04d52-71b6-4678-af6c-767500beea86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:57.849370 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1cb04d52-71b6-4678-af6c-767500beea86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:57.852703 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1cb04d52-71b6-4678-af6c-767500beea86 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1406 microversion: 2.20 time: 0.827230 Jan 18 20:23:57.868004 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 72/135] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:23:57 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1406 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:23:58.052879 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-25f9bf49-4c56-4aef-a59a-692bffcbd8e7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:58.072817 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-25f9bf49-4c56-4aef-a59a-692bffcbd8e7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.394310 Jan 18 20:23:58.074263 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 64/136] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:57 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:58.875425 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5ca098b1-083e-451d-a7ce-7ef74075ecef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:58.876221 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5ca098b1-083e-451d-a7ce-7ef74075ecef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:58.884553 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5ca098b1-083e-451d-a7ce-7ef74075ecef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:58.886474 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5ca098b1-083e-451d-a7ce-7ef74075ecef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:58.887438 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5ca098b1-083e-451d-a7ce-7ef74075ecef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:58.888089 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5ca098b1-083e-451d-a7ce-7ef74075ecef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:59.104101 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0417c98f-5c7e-491a-843e-6724c9fc4d14 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:23:59.106205 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0417c98f-5c7e-491a-843e-6724c9fc4d14 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:59.111654 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0417c98f-5c7e-491a-843e-6724c9fc4d14 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:59.112434 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0417c98f-5c7e-491a-843e-6724c9fc4d14 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:59.113325 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0417c98f-5c7e-491a-843e-6724c9fc4d14 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:59.113751 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0417c98f-5c7e-491a-843e-6724c9fc4d14 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:59.211520 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5ca098b1-083e-451d-a7ce-7ef74075ecef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:59.222226 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5ca098b1-083e-451d-a7ce-7ef74075ecef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:59.225882 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5ca098b1-083e-451d-a7ce-7ef74075ecef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:59.226755 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5ca098b1-083e-451d-a7ce-7ef74075ecef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1406 microversion: 2.20 time: 0.355656 Jan 18 20:23:59.232896 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 73/137] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:23:58 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1406 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:23:59.318976 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-0417c98f-5c7e-491a-843e-6724c9fc4d14 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:23:59.327470 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0417c98f-5c7e-491a-843e-6724c9fc4d14 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.227573 Jan 18 20:23:59.328822 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 65/138] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:23:59 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:23:59.630111 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d33893f4-b63c-4a9b-9589-abdc722e9c1a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:59.633338 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d33893f4-b63c-4a9b-9589-abdc722e9c1a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:23:59.635862 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-bb622446-1c7f-4959-88f5-900d27f3e57a req-91d02640-7873-4c12-bd75-31bc9fbf73b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6e08025-ad66-4921-8672-ab55c85cbfb4", "tag": "df2b9969-bf44-42c9-86a4-02ad9e3ae1d7"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:59.637681 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:23:59.637681 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:23:59.645773 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-bb622446-1c7f-4959-88f5-900d27f3e57a req-91d02640-7873-4c12-bd75-31bc9fbf73b0 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:59.646230 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-bb622446-1c7f-4959-88f5-900d27f3e57a req-91d02640-7873-4c12-bd75-31bc9fbf73b0 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:59.646418 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d33893f4-b63c-4a9b-9589-abdc722e9c1a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:59.646895 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d33893f4-b63c-4a9b-9589-abdc722e9c1a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:59.647866 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d33893f4-b63c-4a9b-9589-abdc722e9c1a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:23:59.648458 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d33893f4-b63c-4a9b-9589-abdc722e9c1a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:23:59.659977 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-bb622446-1c7f-4959-88f5-900d27f3e57a req-91d02640-7873-4c12-bd75-31bc9fbf73b0 service nova] Creating event network-changed:df2b9969-bf44-42c9-86a4-02ad9e3ae1d7 for instance b6e08025-ad66-4921-8672-ab55c85cbfb4 on hv-cinder-82160 Jan 18 20:23:59.665599 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-bb622446-1c7f-4959-88f5-900d27f3e57a req-91d02640-7873-4c12-bd75-31bc9fbf73b0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033462 Jan 18 20:23:59.669577 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 66/139] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:23:59.675335 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-dcf34ccb-9f7b-4f04-891e-056db2672a40 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1136063916", "imageRef": "c7d259ac-b206-430f-a3c0-794cee408236", "flavorRef": "452", "networks": [{"uuid": "dcb439eb-a130-48e2-8bcd-35ade9b8c9da"}]}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:23:59.737912 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.network.neutron [None req-dcf34ccb-9f7b-4f04-891e-056db2672a40 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] validate_networks() for [('dcb439eb-a130-48e2-8bcd-35ade9b8c9da', None, None, None, None, None)] {{(pid=116376) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:23:59.766741 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d33893f4-b63c-4a9b-9589-abdc722e9c1a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 14 microversion: 2.1 time: 0.138099 Jan 18 20:23:59.767840 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 74/140] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:23:59 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:24:00.272385 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b4734127-a81d-497d-a43b-23d975ec8a05 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:00.276895 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b4734127-a81d-497d-a43b-23d975ec8a05 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:00.310179 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b4734127-a81d-497d-a43b-23d975ec8a05 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:00.315797 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b4734127-a81d-497d-a43b-23d975ec8a05 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:00.325392 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b4734127-a81d-497d-a43b-23d975ec8a05 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:00.326581 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b4734127-a81d-497d-a43b-23d975ec8a05 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:00.457665 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-dcf34ccb-9f7b-4f04-891e-056db2672a40 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Flavor limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:24:00.459422 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-dcf34ccb-9f7b-4f04-891e-056db2672a40 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Image limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:24:00.460188 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-dcf34ccb-9f7b-4f04-891e-056db2672a40 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Flavor pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:24:00.460825 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-dcf34ccb-9f7b-4f04-891e-056db2672a40 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Image pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:24:00.461440 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-dcf34ccb-9f7b-4f04-891e-056db2672a40 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:24:00.482828 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dcf34ccb-9f7b-4f04-891e-056db2672a40 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:00.483403 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dcf34ccb-9f7b-4f04-891e-056db2672a40 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:00.484480 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dcf34ccb-9f7b-4f04-891e-056db2672a40 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:00.485229 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dcf34ccb-9f7b-4f04-891e-056db2672a40 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:00.508491 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-dcf34ccb-9f7b-4f04-891e-056db2672a40 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Getting quotas for project ac7d65640ff94651a7ef1d826ade4cfe. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:24:00.513474 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-dcf34ccb-9f7b-4f04-891e-056db2672a40 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Getting quotas for user 6c8a95c08cbe4253b4c279403eeb2bb6 and project ac7d65640ff94651a7ef1d826ade4cfe. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:24:00.545342 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-dcf34ccb-9f7b-4f04-891e-056db2672a40 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Going to run 1 instances... {{(pid=116376) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:24:00.550579 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-dcf34ccb-9f7b-4f04-891e-056db2672a40 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7d259ac-b206-430f-a3c0-794cee408236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116376) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:24:00.728995 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-dcf34ccb-9f7b-4f04-891e-056db2672a40 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.057998 Jan 18 20:24:00.730004 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 67/141] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:23:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 20:24:00.741778 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-3a0b6b21-a46e-40a4-87a2-231feed2cddb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:00.742410 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-3a0b6b21-a46e-40a4-87a2-231feed2cddb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:00.775647 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3a0b6b21-a46e-40a4-87a2-231feed2cddb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:00.775647 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3a0b6b21-a46e-40a4-87a2-231feed2cddb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:00.775647 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3a0b6b21-a46e-40a4-87a2-231feed2cddb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:00.775647 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3a0b6b21-a46e-40a4-87a2-231feed2cddb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:00.894223 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b4734127-a81d-497d-a43b-23d975ec8a05 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:00.912757 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b4734127-a81d-497d-a43b-23d975ec8a05 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:00.918740 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b4734127-a81d-497d-a43b-23d975ec8a05 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:00.922229 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b4734127-a81d-497d-a43b-23d975ec8a05 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1597 microversion: 2.20 time: 0.664748 Jan 18 20:24:00.941026 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 75/142] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:24:00 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1597 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:24:00.953228 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6428f7a0-1387-47c9-a229-fb549d53e996 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:00.954257 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6428f7a0-1387-47c9-a229-fb549d53e996 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:01.113409 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6428f7a0-1387-47c9-a229-fb549d53e996 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:01.127852 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6428f7a0-1387-47c9-a229-fb549d53e996 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1218 microversion: 2.1 time: 0.180137 Jan 18 20:24:01.128692 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 76/143] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:00 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1218 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:01.147360 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-00888bcb-b787-42a0-adf8-9dc967b6ff17 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:01.149521 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-00888bcb-b787-42a0-adf8-9dc967b6ff17 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:01.172770 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-00888bcb-b787-42a0-adf8-9dc967b6ff17 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:01.173749 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-00888bcb-b787-42a0-adf8-9dc967b6ff17 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:01.175176 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-00888bcb-b787-42a0-adf8-9dc967b6ff17 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:01.176060 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-00888bcb-b787-42a0-adf8-9dc967b6ff17 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:01.328318 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-00888bcb-b787-42a0-adf8-9dc967b6ff17 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 14 microversion: 2.1 time: 0.190768 Jan 18 20:24:01.334101 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 77/144] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:01 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:24:01.352984 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c653899c-8fa5-4b86-ac2d-770a026081f7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:01.354445 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c653899c-8fa5-4b86-ac2d-770a026081f7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:01.390912 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c653899c-8fa5-4b86-ac2d-770a026081f7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:01.392329 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c653899c-8fa5-4b86-ac2d-770a026081f7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:01.397557 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c653899c-8fa5-4b86-ac2d-770a026081f7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:01.398576 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c653899c-8fa5-4b86-ac2d-770a026081f7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:01.535516 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-3a0b6b21-a46e-40a4-87a2-231feed2cddb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:01.561067 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-3a0b6b21-a46e-40a4-87a2-231feed2cddb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.829719 Jan 18 20:24:01.568791 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 68/145] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:00 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:01.852912 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c653899c-8fa5-4b86-ac2d-770a026081f7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.515337 Jan 18 20:24:01.859763 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 78/146] 10.222.0.67 () {60 vars in 1315 bytes} [Tue Jan 18 20:24:01 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/os-interface => generated 284 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:02.181073 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-121d4ee7-b416-4a5a-b39e-9777aafd3de9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:02.183099 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-121d4ee7-b416-4a5a-b39e-9777aafd3de9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:02.210786 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-121d4ee7-b416-4a5a-b39e-9777aafd3de9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:02.218264 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-121d4ee7-b416-4a5a-b39e-9777aafd3de9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:02.221214 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-121d4ee7-b416-4a5a-b39e-9777aafd3de9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:02.222278 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-121d4ee7-b416-4a5a-b39e-9777aafd3de9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:02.352718 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2d739ed0-786a-4151-bd07-4dc15fdc0c90 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:02.356755 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2d739ed0-786a-4151-bd07-4dc15fdc0c90 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:02.385476 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2d739ed0-786a-4151-bd07-4dc15fdc0c90 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:02.386184 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2d739ed0-786a-4151-bd07-4dc15fdc0c90 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:02.387234 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2d739ed0-786a-4151-bd07-4dc15fdc0c90 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:02.387834 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2d739ed0-786a-4151-bd07-4dc15fdc0c90 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:02.460733 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-121d4ee7-b416-4a5a-b39e-9777aafd3de9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:02.480917 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-121d4ee7-b416-4a5a-b39e-9777aafd3de9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1214 microversion: 2.1 time: 0.317305 Jan 18 20:24:02.482590 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 69/147] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:02 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1214 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:24:02.516387 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2d739ed0-786a-4151-bd07-4dc15fdc0c90 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 14 microversion: 2.1 time: 0.170471 Jan 18 20:24:02.519747 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 79/148] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:02 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 18 20:24:02.586172 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-bd58107e-0263-4ac1-b986-25c352de052c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:02.587618 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-bd58107e-0263-4ac1-b986-25c352de052c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:02.596408 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bd58107e-0263-4ac1-b986-25c352de052c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:02.597469 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bd58107e-0263-4ac1-b986-25c352de052c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:02.599191 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bd58107e-0263-4ac1-b986-25c352de052c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:02.599906 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bd58107e-0263-4ac1-b986-25c352de052c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:03.001711 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-bd58107e-0263-4ac1-b986-25c352de052c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:03.018020 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-bd58107e-0263-4ac1-b986-25c352de052c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.436685 Jan 18 20:24:03.027134 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 70/149] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:02 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:03.500901 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2329497a-f681-4617-bd4f-55bb1b044ca1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:03.502181 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2329497a-f681-4617-bd4f-55bb1b044ca1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:03.514857 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2329497a-f681-4617-bd4f-55bb1b044ca1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:03.515640 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2329497a-f681-4617-bd4f-55bb1b044ca1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:03.516722 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2329497a-f681-4617-bd4f-55bb1b044ca1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:03.517203 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2329497a-f681-4617-bd4f-55bb1b044ca1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:03.530108 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-c0a40af1-f8c7-42bd-9157-d86d7d5ee413 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:03.531145 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-c0a40af1-f8c7-42bd-9157-d86d7d5ee413 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:03.545508 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c0a40af1-f8c7-42bd-9157-d86d7d5ee413 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:03.545946 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c0a40af1-f8c7-42bd-9157-d86d7d5ee413 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:03.546760 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c0a40af1-f8c7-42bd-9157-d86d7d5ee413 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:03.547497 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c0a40af1-f8c7-42bd-9157-d86d7d5ee413 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:03.693548 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-c0a40af1-f8c7-42bd-9157-d86d7d5ee413 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 14 microversion: 2.1 time: 0.167079 Jan 18 20:24:03.694417 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 71/150] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:03 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 18 20:24:03.802173 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2329497a-f681-4617-bd4f-55bb1b044ca1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:03.815203 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2329497a-f681-4617-bd4f-55bb1b044ca1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1276 microversion: 2.1 time: 0.316429 Jan 18 20:24:03.816172 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 80/151] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:03 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1276 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:04.043319 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d258397c-ade3-4ac2-bf0b-4b6b40c98fde tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:04.044694 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d258397c-ade3-4ac2-bf0b-4b6b40c98fde tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:04.059954 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d258397c-ade3-4ac2-bf0b-4b6b40c98fde tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:04.061163 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d258397c-ade3-4ac2-bf0b-4b6b40c98fde tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:04.065415 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d258397c-ade3-4ac2-bf0b-4b6b40c98fde tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:04.066198 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d258397c-ade3-4ac2-bf0b-4b6b40c98fde tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:04.478928 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d258397c-ade3-4ac2-bf0b-4b6b40c98fde tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:04.489490 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d258397c-ade3-4ac2-bf0b-4b6b40c98fde tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.452315 Jan 18 20:24:04.490667 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 72/152] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:04 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:04.712933 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1e731080-794a-478c-8a1f-1769958349b5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:04.716143 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1e731080-794a-478c-8a1f-1769958349b5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:04.730600 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1e731080-794a-478c-8a1f-1769958349b5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:04.731937 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1e731080-794a-478c-8a1f-1769958349b5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:04.733598 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1e731080-794a-478c-8a1f-1769958349b5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:04.734758 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1e731080-794a-478c-8a1f-1769958349b5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:04.842173 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-65854998-f2ea-47d9-b246-a2b34ea14158 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:04.843215 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-65854998-f2ea-47d9-b246-a2b34ea14158 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:04.872051 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1e731080-794a-478c-8a1f-1769958349b5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 14 microversion: 2.1 time: 0.169026 Jan 18 20:24:04.873594 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 81/153] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:04 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:24:04.878176 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-65854998-f2ea-47d9-b246-a2b34ea14158 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:04.884920 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-65854998-f2ea-47d9-b246-a2b34ea14158 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:04.888379 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-65854998-f2ea-47d9-b246-a2b34ea14158 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:04.889662 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-65854998-f2ea-47d9-b246-a2b34ea14158 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:05.040062 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-65854998-f2ea-47d9-b246-a2b34ea14158 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:05.054314 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-65854998-f2ea-47d9-b246-a2b34ea14158 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1276 microversion: 2.1 time: 0.216003 Jan 18 20:24:05.065312 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 73/154] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:04 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1276 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:24:05.303274 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6cf8ba2f-4c47-42db-87ba-c5d792d7cc28 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:05.318368 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-a2e2fa52-baf5-4088-81d5-ec2e0e7561c3 req-1650019d-21b0-4109-82e0-a8a99bcce3af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54f16911-8813-49b1-a940-9d83c6a5b131", "tag": "555e1e24-9775-40bc-b590-9ec8763d4dd0"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:05.324290 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6cf8ba2f-4c47-42db-87ba-c5d792d7cc28 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:05.328202 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:24:05.328202 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:24:05.383497 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6cf8ba2f-4c47-42db-87ba-c5d792d7cc28 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:05.389435 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6cf8ba2f-4c47-42db-87ba-c5d792d7cc28 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:05.393283 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-a2e2fa52-baf5-4088-81d5-ec2e0e7561c3 req-1650019d-21b0-4109-82e0-a8a99bcce3af service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:05.393741 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-a2e2fa52-baf5-4088-81d5-ec2e0e7561c3 req-1650019d-21b0-4109-82e0-a8a99bcce3af service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:05.394304 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6cf8ba2f-4c47-42db-87ba-c5d792d7cc28 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:05.399582 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6cf8ba2f-4c47-42db-87ba-c5d792d7cc28 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:05.423196 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-a2e2fa52-baf5-4088-81d5-ec2e0e7561c3 req-1650019d-21b0-4109-82e0-a8a99bcce3af service nova] Creating event network-changed:555e1e24-9775-40bc-b590-9ec8763d4dd0 for instance 54f16911-8813-49b1-a940-9d83c6a5b131 on hv-cinder-82160 Jan 18 20:24:05.441193 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-a2e2fa52-baf5-4088-81d5-ec2e0e7561c3 req-1650019d-21b0-4109-82e0-a8a99bcce3af service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133772 Jan 18 20:24:05.448402 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 74/155] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:24:05.509486 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-238c0af6-635b-4dae-ba79-6be5865bac65 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:05.511017 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-238c0af6-635b-4dae-ba79-6be5865bac65 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:05.530689 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-238c0af6-635b-4dae-ba79-6be5865bac65 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:05.532264 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-238c0af6-635b-4dae-ba79-6be5865bac65 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:05.539120 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-238c0af6-635b-4dae-ba79-6be5865bac65 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:05.539952 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-238c0af6-635b-4dae-ba79-6be5865bac65 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:05.657827 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6cf8ba2f-4c47-42db-87ba-c5d792d7cc28 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 14 microversion: 2.20 time: 0.368038 Jan 18 20:24:05.664797 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 82/156] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:05 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 14 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:05.890520 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c317d0fd-2b11-4ac1-bedb-59b980592de7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:05.901260 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c317d0fd-2b11-4ac1-bedb-59b980592de7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:05.953549 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c317d0fd-2b11-4ac1-bedb-59b980592de7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:05.960844 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c317d0fd-2b11-4ac1-bedb-59b980592de7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:05.967524 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c317d0fd-2b11-4ac1-bedb-59b980592de7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:05.975362 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c317d0fd-2b11-4ac1-bedb-59b980592de7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:06.209982 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c317d0fd-2b11-4ac1-bedb-59b980592de7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 14 microversion: 2.1 time: 0.327284 Jan 18 20:24:06.215656 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 83/157] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:05 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 14 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:24:06.233772 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-efeec903-b872-48c6-8783-dd0b441d6429 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:06.240754 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-efeec903-b872-48c6-8783-dd0b441d6429 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:06.259922 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-efeec903-b872-48c6-8783-dd0b441d6429 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:06.266899 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-efeec903-b872-48c6-8783-dd0b441d6429 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:06.272238 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-efeec903-b872-48c6-8783-dd0b441d6429 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:06.273484 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-efeec903-b872-48c6-8783-dd0b441d6429 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:06.735088 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-efeec903-b872-48c6-8783-dd0b441d6429 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:06.743357 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-efeec903-b872-48c6-8783-dd0b441d6429 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1318 microversion: 2.1 time: 0.525499 Jan 18 20:24:06.747511 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 84/158] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:06 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:06.765366 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-725e7ad1-2f9a-4d7b-9d32-0e3fd794421e tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:06.767974 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-725e7ad1-2f9a-4d7b-9d32-0e3fd794421e tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:06.783255 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-238c0af6-635b-4dae-ba79-6be5865bac65 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:06.786081 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-725e7ad1-2f9a-4d7b-9d32-0e3fd794421e tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:06.787322 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-725e7ad1-2f9a-4d7b-9d32-0e3fd794421e tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:06.789094 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-725e7ad1-2f9a-4d7b-9d32-0e3fd794421e tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:06.790485 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-725e7ad1-2f9a-4d7b-9d32-0e3fd794421e tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:06.790910 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-238c0af6-635b-4dae-ba79-6be5865bac65 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 1.287657 Jan 18 20:24:06.812704 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 75/159] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:05 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:06.825437 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d17191cf-413a-497e-846d-b21a315d5407 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:06.830920 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d17191cf-413a-497e-846d-b21a315d5407 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:06.842687 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-725e7ad1-2f9a-4d7b-9d32-0e3fd794421e tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:24:06.852422 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d17191cf-413a-497e-846d-b21a315d5407 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:06.852872 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d17191cf-413a-497e-846d-b21a315d5407 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:06.853665 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d17191cf-413a-497e-846d-b21a315d5407 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:06.854094 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d17191cf-413a-497e-846d-b21a315d5407 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:06.992741 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d17191cf-413a-497e-846d-b21a315d5407 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 14 microversion: 2.20 time: 0.178186 Jan 18 20:24:06.993620 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 76/160] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:06 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:07.020451 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-725e7ad1-2f9a-4d7b-9d32-0e3fd794421e tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 204 len: 0 microversion: 2.1 time: 0.271336 Jan 18 20:24:07.021053 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 85/161] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:24:06 2022] DELETE /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:24:07.032768 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-77fa37b7-8c38-4c37-b47e-3154b98d439e tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:07.033966 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-77fa37b7-8c38-4c37-b47e-3154b98d439e tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:07.052627 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-77fa37b7-8c38-4c37-b47e-3154b98d439e tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:07.054457 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-77fa37b7-8c38-4c37-b47e-3154b98d439e tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:07.055678 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-77fa37b7-8c38-4c37-b47e-3154b98d439e tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:07.057675 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-77fa37b7-8c38-4c37-b47e-3154b98d439e tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:07.228391 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-baa2788e-b82a-4ad2-a112-51e60aad0fee tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:07.232395 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-baa2788e-b82a-4ad2-a112-51e60aad0fee tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:07.247395 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-baa2788e-b82a-4ad2-a112-51e60aad0fee tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:07.247762 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-baa2788e-b82a-4ad2-a112-51e60aad0fee tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:07.248860 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-baa2788e-b82a-4ad2-a112-51e60aad0fee tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:07.249334 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-baa2788e-b82a-4ad2-a112-51e60aad0fee tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:07.373919 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-baa2788e-b82a-4ad2-a112-51e60aad0fee tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 14 microversion: 2.1 time: 0.154708 Jan 18 20:24:07.376601 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 86/162] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:07 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 18 20:24:07.414645 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-77fa37b7-8c38-4c37-b47e-3154b98d439e tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:07.422954 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-77fa37b7-8c38-4c37-b47e-3154b98d439e tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1553 microversion: 2.1 time: 0.396347 Jan 18 20:24:07.423581 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 77/163] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:07 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1553 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:24:07.606859 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-6da95ee7-03da-4c5f-9848-9cad990d81c7 req-cd755e8b-69c1-4c01-8c02-73464acbd308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7866fc9-233f-4a31-85ae-87b6b5cf9474", "tag": "8e771083-6f01-41a0-aae7-67a33901263a"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:07.627184 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:24:07.627184 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:24:07.639318 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-6da95ee7-03da-4c5f-9848-9cad990d81c7 req-cd755e8b-69c1-4c01-8c02-73464acbd308 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:07.639772 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-6da95ee7-03da-4c5f-9848-9cad990d81c7 req-cd755e8b-69c1-4c01-8c02-73464acbd308 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:07.671625 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-6da95ee7-03da-4c5f-9848-9cad990d81c7 req-cd755e8b-69c1-4c01-8c02-73464acbd308 service nova] Creating event network-changed:8e771083-6f01-41a0-aae7-67a33901263a for instance c7866fc9-233f-4a31-85ae-87b6b5cf9474 on hv-cinder-82160 Jan 18 20:24:07.679575 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-6da95ee7-03da-4c5f-9848-9cad990d81c7 req-cd755e8b-69c1-4c01-8c02-73464acbd308 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088715 Jan 18 20:24:07.681495 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 87/164] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:24:07.765397 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-30a7c5d8-fdbc-4518-8d12-b868d2e99780 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:07.768654 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-30a7c5d8-fdbc-4518-8d12-b868d2e99780 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:07.781757 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-30a7c5d8-fdbc-4518-8d12-b868d2e99780 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:07.782688 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-30a7c5d8-fdbc-4518-8d12-b868d2e99780 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:07.784296 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-30a7c5d8-fdbc-4518-8d12-b868d2e99780 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:07.785390 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-30a7c5d8-fdbc-4518-8d12-b868d2e99780 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:07.821115 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-23e056d0-fce4-44a1-acef-343fbadf241f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:07.821854 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-23e056d0-fce4-44a1-acef-343fbadf241f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:07.844338 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-23e056d0-fce4-44a1-acef-343fbadf241f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:07.845133 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-23e056d0-fce4-44a1-acef-343fbadf241f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:07.846140 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-23e056d0-fce4-44a1-acef-343fbadf241f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:07.846585 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-23e056d0-fce4-44a1-acef-343fbadf241f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:08.101856 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-23e056d0-fce4-44a1-acef-343fbadf241f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:08.111745 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-23e056d0-fce4-44a1-acef-343fbadf241f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.304156 Jan 18 20:24:08.112339 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 88/165] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:07 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:08.118899 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-dfd21845-90d9-48ea-99c0-374247f72ee2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:08.119865 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-dfd21845-90d9-48ea-99c0-374247f72ee2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:08.135534 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dfd21845-90d9-48ea-99c0-374247f72ee2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:08.136204 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dfd21845-90d9-48ea-99c0-374247f72ee2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:08.137548 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dfd21845-90d9-48ea-99c0-374247f72ee2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:08.138189 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dfd21845-90d9-48ea-99c0-374247f72ee2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:08.299457 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-30a7c5d8-fdbc-4518-8d12-b868d2e99780 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:08.318645 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-30a7c5d8-fdbc-4518-8d12-b868d2e99780 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1318 microversion: 2.1 time: 0.556637 Jan 18 20:24:08.327552 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 78/166] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:07 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:08.342539 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-dfd21845-90d9-48ea-99c0-374247f72ee2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 14 microversion: 2.20 time: 0.228596 Jan 18 20:24:08.343215 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 89/167] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:08 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 14 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:08.388907 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-2ff70f11-f786-413c-849f-7a88fa0ab3f3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:08.389977 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-2ff70f11-f786-413c-849f-7a88fa0ab3f3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:08.397974 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2ff70f11-f786-413c-849f-7a88fa0ab3f3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:08.399458 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2ff70f11-f786-413c-849f-7a88fa0ab3f3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:08.400974 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2ff70f11-f786-413c-849f-7a88fa0ab3f3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:08.401609 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2ff70f11-f786-413c-849f-7a88fa0ab3f3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:08.449827 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4a83f7fb-531f-4571-bb4b-7b1342c13805 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:08.450847 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4a83f7fb-531f-4571-bb4b-7b1342c13805 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:08.459197 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a83f7fb-531f-4571-bb4b-7b1342c13805 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:08.459674 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a83f7fb-531f-4571-bb4b-7b1342c13805 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:08.460651 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a83f7fb-531f-4571-bb4b-7b1342c13805 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:08.461263 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a83f7fb-531f-4571-bb4b-7b1342c13805 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:08.501344 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2ff70f11-f786-413c-849f-7a88fa0ab3f3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 14 microversion: 2.1 time: 0.116243 Jan 18 20:24:08.504723 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 79/168] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:08 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:24:08.675294 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4a83f7fb-531f-4571-bb4b-7b1342c13805 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:08.692257 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4a83f7fb-531f-4571-bb4b-7b1342c13805 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1553 microversion: 2.1 time: 0.246114 Jan 18 20:24:08.693652 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 90/169] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:08 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1553 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:24:09.145048 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7cece1b0-1007-4c6f-ba8f-2b67d6510f55 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:09.146506 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-7cece1b0-1007-4c6f-ba8f-2b67d6510f55 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:09.153756 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7cece1b0-1007-4c6f-ba8f-2b67d6510f55 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:09.154502 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7cece1b0-1007-4c6f-ba8f-2b67d6510f55 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:09.155340 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7cece1b0-1007-4c6f-ba8f-2b67d6510f55 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:09.155775 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7cece1b0-1007-4c6f-ba8f-2b67d6510f55 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:09.350760 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5562a6f3-7311-4a93-ae46-1943ceb04a5b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:09.351818 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5562a6f3-7311-4a93-ae46-1943ceb04a5b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:09.367230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5562a6f3-7311-4a93-ae46-1943ceb04a5b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:09.368034 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5562a6f3-7311-4a93-ae46-1943ceb04a5b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:09.369075 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5562a6f3-7311-4a93-ae46-1943ceb04a5b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:09.369908 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5562a6f3-7311-4a93-ae46-1943ceb04a5b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:09.498915 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-7cece1b0-1007-4c6f-ba8f-2b67d6510f55 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:09.519380 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7cece1b0-1007-4c6f-ba8f-2b67d6510f55 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.378124 Jan 18 20:24:09.534121 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 80/170] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:09 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:09.541256 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-94edf273-736d-4195-925d-84ff530a59ec tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:09.543758 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-94edf273-736d-4195-925d-84ff530a59ec tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:09.551911 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-94edf273-736d-4195-925d-84ff530a59ec tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:09.553529 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-94edf273-736d-4195-925d-84ff530a59ec tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:09.556449 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-94edf273-736d-4195-925d-84ff530a59ec tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:09.556904 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-94edf273-736d-4195-925d-84ff530a59ec tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:09.624463 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5562a6f3-7311-4a93-ae46-1943ceb04a5b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:09.634146 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5562a6f3-7311-4a93-ae46-1943ceb04a5b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1318 microversion: 2.1 time: 0.289833 Jan 18 20:24:09.634729 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 91/171] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:09 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:09.648781 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4f833f08-41a3-4748-8308-3fe5326bc59f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:09.649840 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4f833f08-41a3-4748-8308-3fe5326bc59f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:09.656490 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4f833f08-41a3-4748-8308-3fe5326bc59f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:09.656944 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4f833f08-41a3-4748-8308-3fe5326bc59f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:09.657742 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4f833f08-41a3-4748-8308-3fe5326bc59f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:09.658349 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4f833f08-41a3-4748-8308-3fe5326bc59f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:09.680730 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-94edf273-736d-4195-925d-84ff530a59ec tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 14 microversion: 2.20 time: 0.142417 Jan 18 20:24:09.681740 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 81/172] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:09 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:09.729506 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-84c24c94-4d0c-45da-bda5-47b4c711c2c4 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:09.731980 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-84c24c94-4d0c-45da-bda5-47b4c711c2c4 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:09.752224 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-84c24c94-4d0c-45da-bda5-47b4c711c2c4 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:09.753053 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-84c24c94-4d0c-45da-bda5-47b4c711c2c4 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:09.754460 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-84c24c94-4d0c-45da-bda5-47b4c711c2c4 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:09.755507 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-84c24c94-4d0c-45da-bda5-47b4c711c2c4 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:09.765042 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4f833f08-41a3-4748-8308-3fe5326bc59f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 14 microversion: 2.1 time: 0.120328 Jan 18 20:24:09.766413 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 92/173] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:09 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:24:09.959517 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-84c24c94-4d0c-45da-bda5-47b4c711c2c4 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:09.967955 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-84c24c94-4d0c-45da-bda5-47b4c711c2c4 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1553 microversion: 2.1 time: 0.245823 Jan 18 20:24:09.968620 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 82/174] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:09 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1553 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:24:10.541071 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9b3aea05-9ba7-428e-8a43-1b8b792d1345 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:10.541761 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9b3aea05-9ba7-428e-8a43-1b8b792d1345 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:10.556728 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b3aea05-9ba7-428e-8a43-1b8b792d1345 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:10.560003 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b3aea05-9ba7-428e-8a43-1b8b792d1345 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:10.561564 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b3aea05-9ba7-428e-8a43-1b8b792d1345 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:10.562440 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b3aea05-9ba7-428e-8a43-1b8b792d1345 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:10.652321 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-bfe32538-9113-49f1-a88f-d83f0c7529d3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:10.653710 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-bfe32538-9113-49f1-a88f-d83f0c7529d3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:10.664907 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bfe32538-9113-49f1-a88f-d83f0c7529d3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:10.665651 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bfe32538-9113-49f1-a88f-d83f0c7529d3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:10.667497 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bfe32538-9113-49f1-a88f-d83f0c7529d3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:10.668101 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bfe32538-9113-49f1-a88f-d83f0c7529d3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:10.842960 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9b3aea05-9ba7-428e-8a43-1b8b792d1345 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:10.866055 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9b3aea05-9ba7-428e-8a43-1b8b792d1345 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.328921 Jan 18 20:24:10.880111 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 93/175] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:10 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:10.888243 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2f5e274e-0a93-4b44-97b2-ba41136e17c0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:10.888243 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2f5e274e-0a93-4b44-97b2-ba41136e17c0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:10.895937 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2f5e274e-0a93-4b44-97b2-ba41136e17c0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:10.896453 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2f5e274e-0a93-4b44-97b2-ba41136e17c0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:10.897455 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2f5e274e-0a93-4b44-97b2-ba41136e17c0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:10.897850 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2f5e274e-0a93-4b44-97b2-ba41136e17c0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:10.958292 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-bfe32538-9113-49f1-a88f-d83f0c7529d3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:10.971182 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-bfe32538-9113-49f1-a88f-d83f0c7529d3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1318 microversion: 2.1 time: 0.322231 Jan 18 20:24:10.974057 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 83/176] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:10 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:24:10.977369 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2f5e274e-0a93-4b44-97b2-ba41136e17c0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 14 microversion: 2.20 time: 0.094719 Jan 18 20:24:10.978381 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 94/177] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:10 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:10.987233 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4c94c92c-aafe-4728-8989-c2f2d1c4a99a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:10.990733 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-4c94c92c-aafe-4728-8989-c2f2d1c4a99a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:10.991955 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-03d486c9-cb1a-4e1d-b196-356c0e019bc9 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:10.993306 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-03d486c9-cb1a-4e1d-b196-356c0e019bc9 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:11.000465 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4c94c92c-aafe-4728-8989-c2f2d1c4a99a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:11.000963 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4c94c92c-aafe-4728-8989-c2f2d1c4a99a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:11.002635 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4c94c92c-aafe-4728-8989-c2f2d1c4a99a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:11.003168 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4c94c92c-aafe-4728-8989-c2f2d1c4a99a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:11.006785 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-03d486c9-cb1a-4e1d-b196-356c0e019bc9 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:11.008049 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-03d486c9-cb1a-4e1d-b196-356c0e019bc9 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:11.009901 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-03d486c9-cb1a-4e1d-b196-356c0e019bc9 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:11.011327 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-03d486c9-cb1a-4e1d-b196-356c0e019bc9 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:11.150135 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-4c94c92c-aafe-4728-8989-c2f2d1c4a99a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 14 microversion: 2.1 time: 0.169235 Jan 18 20:24:11.151746 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 84/178] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:10 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:24:11.171568 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-03d486c9-cb1a-4e1d-b196-356c0e019bc9 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:11.182465 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-03d486c9-cb1a-4e1d-b196-356c0e019bc9 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1511 microversion: 2.1 time: 0.198468 Jan 18 20:24:11.187094 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 95/179] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:10 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:11.190093 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-cb13aecd-cd3d-474c-937e-6c4fe1cd4f54 req-85525053-c20f-4155-830c-71caa84dbd9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2962a0f0-ce3a-4351-84d7-f3155f5bd129", "name": "network-vif-deleted", "tag": "606d225c-d6f1-491e-8ba1-c66d52808c4b"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:11.192106 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:24:11.192106 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:24:11.200847 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-cb13aecd-cd3d-474c-937e-6c4fe1cd4f54 req-85525053-c20f-4155-830c-71caa84dbd9f service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:11.201279 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-cb13aecd-cd3d-474c-937e-6c4fe1cd4f54 req-85525053-c20f-4155-830c-71caa84dbd9f service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:11.357824 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-cb13aecd-cd3d-474c-937e-6c4fe1cd4f54 req-85525053-c20f-4155-830c-71caa84dbd9f service nova] Creating event network-vif-deleted:606d225c-d6f1-491e-8ba1-c66d52808c4b for instance 2962a0f0-ce3a-4351-84d7-f3155f5bd129 on hv-cinder-82160 Jan 18 20:24:11.362981 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-cb13aecd-cd3d-474c-937e-6c4fe1cd4f54 req-85525053-c20f-4155-830c-71caa84dbd9f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189662 Jan 18 20:24:11.364097 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 85/180] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:24:11.886343 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3739f84e-5004-43e1-aad5-2ec8b56cd4cb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:11.887432 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3739f84e-5004-43e1-aad5-2ec8b56cd4cb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:11.897190 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3739f84e-5004-43e1-aad5-2ec8b56cd4cb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:11.897635 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3739f84e-5004-43e1-aad5-2ec8b56cd4cb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:11.898511 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3739f84e-5004-43e1-aad5-2ec8b56cd4cb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:11.899175 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3739f84e-5004-43e1-aad5-2ec8b56cd4cb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:11.996644 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4130eeb3-2b9c-4646-885b-17b0d87ffc5f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:11.998617 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-4130eeb3-2b9c-4646-885b-17b0d87ffc5f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:12.006404 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4130eeb3-2b9c-4646-885b-17b0d87ffc5f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:12.006863 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4130eeb3-2b9c-4646-885b-17b0d87ffc5f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:12.007710 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4130eeb3-2b9c-4646-885b-17b0d87ffc5f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:12.008283 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4130eeb3-2b9c-4646-885b-17b0d87ffc5f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:12.111949 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3739f84e-5004-43e1-aad5-2ec8b56cd4cb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:12.120413 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-4130eeb3-2b9c-4646-885b-17b0d87ffc5f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 14 microversion: 2.20 time: 0.130796 Jan 18 20:24:12.122896 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 86/181] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:11 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:12.128799 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3739f84e-5004-43e1-aad5-2ec8b56cd4cb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.247178 Jan 18 20:24:12.131127 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 96/182] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:11 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:12.137618 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-def38b89-5b48-4b5b-8c65-217f6b8e6b87 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:12.138873 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-def38b89-5b48-4b5b-8c65-217f6b8e6b87 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:12.154055 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-def38b89-5b48-4b5b-8c65-217f6b8e6b87 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:12.154600 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-def38b89-5b48-4b5b-8c65-217f6b8e6b87 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:12.155548 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-def38b89-5b48-4b5b-8c65-217f6b8e6b87 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:12.156323 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-def38b89-5b48-4b5b-8c65-217f6b8e6b87 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:12.169332 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2659e669-a2e8-42c0-b6c2-738e90ab619d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:12.170579 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2659e669-a2e8-42c0-b6c2-738e90ab619d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:12.185363 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2659e669-a2e8-42c0-b6c2-738e90ab619d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:12.186093 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2659e669-a2e8-42c0-b6c2-738e90ab619d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:12.187234 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2659e669-a2e8-42c0-b6c2-738e90ab619d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:12.188025 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2659e669-a2e8-42c0-b6c2-738e90ab619d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:12.268781 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2659e669-a2e8-42c0-b6c2-738e90ab619d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 14 microversion: 2.1 time: 0.104370 Jan 18 20:24:12.272562 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 97/183] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:12 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:24:12.279673 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-451773af-c1bd-4738-8d43-fdd15740a21f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:12.290651 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-451773af-c1bd-4738-8d43-fdd15740a21f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:12.299291 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-451773af-c1bd-4738-8d43-fdd15740a21f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:12.300300 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-451773af-c1bd-4738-8d43-fdd15740a21f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:12.302009 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-451773af-c1bd-4738-8d43-fdd15740a21f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:12.302483 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-451773af-c1bd-4738-8d43-fdd15740a21f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:12.376750 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-451773af-c1bd-4738-8d43-fdd15740a21f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:12.377648 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-451773af-c1bd-4738-8d43-fdd15740a21f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:12.378822 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-451773af-c1bd-4738-8d43-fdd15740a21f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lazy-loading 'fault' on Instance uuid 2962a0f0-ce3a-4351-84d7-f3155f5bd129 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:24:12.386675 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-def38b89-5b48-4b5b-8c65-217f6b8e6b87 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:12.396016 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-def38b89-5b48-4b5b-8c65-217f6b8e6b87 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1318 microversion: 2.1 time: 0.270771 Jan 18 20:24:12.402793 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 87/184] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:12 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:12.485634 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-451773af-c1bd-4738-8d43-fdd15740a21f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e208af39fae54cebb2a93c20b0f0d317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df14bc8279467abba49fbed7498d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:12.498807 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-451773af-c1bd-4738-8d43-fdd15740a21f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 200 len: 1304 microversion: 2.1 time: 0.225811 Jan 18 20:24:12.501060 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 98/185] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:12 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 1304 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:13.138460 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-85ccfcc1-696f-4c6d-bf7a-d0c87a8111ba tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:13.140166 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-85ccfcc1-696f-4c6d-bf7a-d0c87a8111ba tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:13.149980 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ddc8fbe2-0387-474d-9ea1-10441544e22d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:13.151385 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ddc8fbe2-0387-474d-9ea1-10441544e22d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:13.154171 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-85ccfcc1-696f-4c6d-bf7a-d0c87a8111ba tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:13.155321 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-85ccfcc1-696f-4c6d-bf7a-d0c87a8111ba tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:13.157274 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-85ccfcc1-696f-4c6d-bf7a-d0c87a8111ba tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:13.158307 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-85ccfcc1-696f-4c6d-bf7a-d0c87a8111ba tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:13.170082 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ddc8fbe2-0387-474d-9ea1-10441544e22d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:13.170925 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ddc8fbe2-0387-474d-9ea1-10441544e22d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:13.172470 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ddc8fbe2-0387-474d-9ea1-10441544e22d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:13.173370 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ddc8fbe2-0387-474d-9ea1-10441544e22d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:13.284859 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-85ccfcc1-696f-4c6d-bf7a-d0c87a8111ba tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 14 microversion: 2.20 time: 0.148853 Jan 18 20:24:13.286430 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 88/186] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:13 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:13.299117 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-c9ff2342-209c-4fe7-817a-4b997324800f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:13.302122 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-c9ff2342-209c-4fe7-817a-4b997324800f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:13.319255 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c9ff2342-209c-4fe7-817a-4b997324800f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:13.320365 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c9ff2342-209c-4fe7-817a-4b997324800f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:13.321996 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c9ff2342-209c-4fe7-817a-4b997324800f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:13.322999 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c9ff2342-209c-4fe7-817a-4b997324800f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:13.430743 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ddc8fbe2-0387-474d-9ea1-10441544e22d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:13.432708 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-c9ff2342-209c-4fe7-817a-4b997324800f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 14 microversion: 2.1 time: 0.140812 Jan 18 20:24:13.434143 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 89/187] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:13 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:24:13.451385 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ddc8fbe2-0387-474d-9ea1-10441544e22d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.306838 Jan 18 20:24:13.452758 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 99/188] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:13 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:24:13.455316 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-6f683d9f-af43-4340-9dd5-858868dad0cb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:13.456749 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-6f683d9f-af43-4340-9dd5-858868dad0cb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:13.465412 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6f683d9f-af43-4340-9dd5-858868dad0cb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:13.465993 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6f683d9f-af43-4340-9dd5-858868dad0cb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:13.466891 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6f683d9f-af43-4340-9dd5-858868dad0cb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:13.467805 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6f683d9f-af43-4340-9dd5-858868dad0cb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:13.523659 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-07e82e13-f034-428a-acbf-9c79aeb370e8 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:13.525460 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-07e82e13-f034-428a-acbf-9c79aeb370e8 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:13.550397 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-07e82e13-f034-428a-acbf-9c79aeb370e8 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:13.552167 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-07e82e13-f034-428a-acbf-9c79aeb370e8 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:13.553824 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-07e82e13-f034-428a-acbf-9c79aeb370e8 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:13.555083 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-07e82e13-f034-428a-acbf-9c79aeb370e8 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:13.595761 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-07e82e13-f034-428a-acbf-9c79aeb370e8 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] HTTP exception thrown: Instance 2962a0f0-ce3a-4351-84d7-f3155f5bd129 could not be found. Jan 18 20:24:13.599318 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-07e82e13-f034-428a-acbf-9c79aeb370e8 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Returning 404 to user: Instance 2962a0f0-ce3a-4351-84d7-f3155f5bd129 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:24:13.601547 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-07e82e13-f034-428a-acbf-9c79aeb370e8 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 404 len: 111 microversion: 2.1 time: 0.085950 Jan 18 20:24:13.607734 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 100/189] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:13 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:24:13.652936 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-6f683d9f-af43-4340-9dd5-858868dad0cb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:13.664529 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-6f683d9f-af43-4340-9dd5-858868dad0cb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1318 microversion: 2.1 time: 0.227521 Jan 18 20:24:13.674345 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 90/190] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:13 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:13.779430 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ef88c23e-6042-4c5a-aac7-1d75d99ce32f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:13.781133 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ef88c23e-6042-4c5a-aac7-1d75d99ce32f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:13.815413 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ef88c23e-6042-4c5a-aac7-1d75d99ce32f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:13.816175 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ef88c23e-6042-4c5a-aac7-1d75d99ce32f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:13.818156 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ef88c23e-6042-4c5a-aac7-1d75d99ce32f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:13.819229 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ef88c23e-6042-4c5a-aac7-1d75d99ce32f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:13.869666 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-ef88c23e-6042-4c5a-aac7-1d75d99ce32f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] HTTP exception thrown: Instance 2962a0f0-ce3a-4351-84d7-f3155f5bd129 could not be found. Jan 18 20:24:13.871133 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ef88c23e-6042-4c5a-aac7-1d75d99ce32f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Returning 404 to user: Instance 2962a0f0-ce3a-4351-84d7-f3155f5bd129 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:24:13.873082 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ef88c23e-6042-4c5a-aac7-1d75d99ce32f tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.102134 Jan 18 20:24:13.881218 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 101/191] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:24:13 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129/os-volume_attachments => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:24:14.303258 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-11f53ef4-ca78-4763-a2d1-f8dc9c5c987d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:14.307749 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-11f53ef4-ca78-4763-a2d1-f8dc9c5c987d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:14.319484 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-11f53ef4-ca78-4763-a2d1-f8dc9c5c987d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:14.320008 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-11f53ef4-ca78-4763-a2d1-f8dc9c5c987d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:14.321223 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-11f53ef4-ca78-4763-a2d1-f8dc9c5c987d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:14.321706 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-11f53ef4-ca78-4763-a2d1-f8dc9c5c987d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:14.412797 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-11f53ef4-ca78-4763-a2d1-f8dc9c5c987d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 14 microversion: 2.20 time: 0.117385 Jan 18 20:24:14.416622 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 91/192] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:14 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:24:14.444649 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-abf62892-d5bb-4b20-856c-3377ab58102d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:14.445725 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-abf62892-d5bb-4b20-856c-3377ab58102d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:14.452811 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-abf62892-d5bb-4b20-856c-3377ab58102d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:14.453272 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-abf62892-d5bb-4b20-856c-3377ab58102d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:14.454160 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-abf62892-d5bb-4b20-856c-3377ab58102d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:14.454585 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-abf62892-d5bb-4b20-856c-3377ab58102d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:14.477285 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-1f2b9b02-9db2-4b08-ae1b-85f7d68b799c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:14.478488 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-1f2b9b02-9db2-4b08-ae1b-85f7d68b799c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:14.501297 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1f2b9b02-9db2-4b08-ae1b-85f7d68b799c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:14.502014 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1f2b9b02-9db2-4b08-ae1b-85f7d68b799c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:14.502829 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1f2b9b02-9db2-4b08-ae1b-85f7d68b799c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:14.503336 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1f2b9b02-9db2-4b08-ae1b-85f7d68b799c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:14.538502 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-abf62892-d5bb-4b20-856c-3377ab58102d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 14 microversion: 2.1 time: 0.097029 Jan 18 20:24:14.542977 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 102/193] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:14 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:24:14.676484 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-1f2b9b02-9db2-4b08-ae1b-85f7d68b799c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:14.686312 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1d957634-2072-4b93-9df2-cc91640200b1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:14.686597 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-1f2b9b02-9db2-4b08-ae1b-85f7d68b799c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.216632 Jan 18 20:24:14.687648 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1d957634-2072-4b93-9df2-cc91640200b1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:14.688293 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 92/194] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:14 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:24:14.699780 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1d957634-2072-4b93-9df2-cc91640200b1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:14.700556 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1d957634-2072-4b93-9df2-cc91640200b1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:14.701855 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1d957634-2072-4b93-9df2-cc91640200b1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:14.702590 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1d957634-2072-4b93-9df2-cc91640200b1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:14.891063 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1d957634-2072-4b93-9df2-cc91640200b1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:14.903830 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1d957634-2072-4b93-9df2-cc91640200b1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1318 microversion: 2.1 time: 0.224630 Jan 18 20:24:14.904842 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 103/195] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:14 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:15.257224 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5a1ec356-8832-4a55-9350-c7ed004f58ff tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:15.258189 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-5a1ec356-8832-4a55-9350-c7ed004f58ff tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:15.269850 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5a1ec356-8832-4a55-9350-c7ed004f58ff tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:15.270487 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5a1ec356-8832-4a55-9350-c7ed004f58ff tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:15.272095 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5a1ec356-8832-4a55-9350-c7ed004f58ff tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:15.272858 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5a1ec356-8832-4a55-9350-c7ed004f58ff tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:15.301774 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-5a1ec356-8832-4a55-9350-c7ed004f58ff tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] HTTP exception thrown: Instance 2962a0f0-ce3a-4351-84d7-f3155f5bd129 could not be found. Jan 18 20:24:15.302783 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5a1ec356-8832-4a55-9350-c7ed004f58ff tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Returning 404 to user: Instance 2962a0f0-ce3a-4351-84d7-f3155f5bd129 could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:24:15.304537 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-5a1ec356-8832-4a55-9350-c7ed004f58ff tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 404 len: 111 microversion: 2.1 time: 0.053249 Jan 18 20:24:15.305606 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 93/196] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:24:15 2022] DELETE /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:24:15.315153 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a5f5c8ac-325c-449e-8651-c2596a32b666 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:15.315521 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a5f5c8ac-325c-449e-8651-c2596a32b666 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] [instance: 2962a0f0-ce3a-4351-84d7-f3155f5bd129] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:15.323642 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a5f5c8ac-325c-449e-8651-c2596a32b666 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:15.324089 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a5f5c8ac-325c-449e-8651-c2596a32b666 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:15.324880 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a5f5c8ac-325c-449e-8651-c2596a32b666 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:15.325526 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a5f5c8ac-325c-449e-8651-c2596a32b666 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:15.340177 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-a5f5c8ac-325c-449e-8651-c2596a32b666 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] HTTP exception thrown: Instance 2962a0f0-ce3a-4351-84d7-f3155f5bd129 could not be found. Jan 18 20:24:15.340986 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a5f5c8ac-325c-449e-8651-c2596a32b666 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] Returning 404 to user: Instance 2962a0f0-ce3a-4351-84d7-f3155f5bd129 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:24:15.341886 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a5f5c8ac-325c-449e-8651-c2596a32b666 tempest-DeleteServersTestJSON-1179100681 tempest-DeleteServersTestJSON-1179100681-project] 10.222.0.67 "GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129" status: 404 len: 111 microversion: 2.1 time: 0.031678 Jan 18 20:24:15.342818 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 104/197] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:15 2022] GET /compute/v2.1/servers/2962a0f0-ce3a-4351-84d7-f3155f5bd129 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:24:15.427786 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fb836935-2d3b-4fbd-82e3-f8ae8558c99c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:15.430319 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-fb836935-2d3b-4fbd-82e3-f8ae8558c99c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:15.440859 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fb836935-2d3b-4fbd-82e3-f8ae8558c99c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:15.441596 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fb836935-2d3b-4fbd-82e3-f8ae8558c99c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:15.443009 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fb836935-2d3b-4fbd-82e3-f8ae8558c99c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:15.443624 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fb836935-2d3b-4fbd-82e3-f8ae8558c99c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:15.552040 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c1cdbde1-8a87-4fa1-94b2-70ca2f8dfa1b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:15.553997 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c1cdbde1-8a87-4fa1-94b2-70ca2f8dfa1b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:15.561084 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c1cdbde1-8a87-4fa1-94b2-70ca2f8dfa1b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:15.561415 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c1cdbde1-8a87-4fa1-94b2-70ca2f8dfa1b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:15.563181 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c1cdbde1-8a87-4fa1-94b2-70ca2f8dfa1b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:15.563806 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c1cdbde1-8a87-4fa1-94b2-70ca2f8dfa1b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:17.835584 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c1cdbde1-8a87-4fa1-94b2-70ca2f8dfa1b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 6710 microversion: 2.1 time: 2.287435 Jan 18 20:24:17.843234 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 105/198] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:15 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 6710 bytes in 2291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:24:17.843492 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-fb836935-2d3b-4fbd-82e3-f8ae8558c99c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 14 microversion: 2.20 time: 2.417658 Jan 18 20:24:17.843492 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 94/199] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:15 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 14 bytes in 2421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:24:17.849735 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-756694d7-a244-4ba6-9505-d55c8d1248ec tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:17.850854 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-756694d7-a244-4ba6-9505-d55c8d1248ec tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:17.856094 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c7c83ea2-ff00-47b1-a68e-f7de871ee442 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:17.858503 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c7c83ea2-ff00-47b1-a68e-f7de871ee442 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:17.861270 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-756694d7-a244-4ba6-9505-d55c8d1248ec tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:17.862054 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-756694d7-a244-4ba6-9505-d55c8d1248ec tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:17.864088 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-756694d7-a244-4ba6-9505-d55c8d1248ec tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:17.864909 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-756694d7-a244-4ba6-9505-d55c8d1248ec tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:17.872371 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7c83ea2-ff00-47b1-a68e-f7de871ee442 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:17.873241 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7c83ea2-ff00-47b1-a68e-f7de871ee442 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:17.874804 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7c83ea2-ff00-47b1-a68e-f7de871ee442 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:17.875645 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7c83ea2-ff00-47b1-a68e-f7de871ee442 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:18.063588 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-756694d7-a244-4ba6-9505-d55c8d1248ec tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:18.071900 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-756694d7-a244-4ba6-9505-d55c8d1248ec tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1318 microversion: 2.1 time: 0.228699 Jan 18 20:24:18.074392 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 95/200] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:17 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:18.123988 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c7c83ea2-ff00-47b1-a68e-f7de871ee442 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:18.139908 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c7c83ea2-ff00-47b1-a68e-f7de871ee442 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.299231 Jan 18 20:24:18.140952 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 106/201] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:17 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:18.853888 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b0dc1b57-8444-4c05-bbe7-766027eaeded tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:18.854855 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b0dc1b57-8444-4c05-bbe7-766027eaeded tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:18.862043 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0dc1b57-8444-4c05-bbe7-766027eaeded tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:18.862498 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0dc1b57-8444-4c05-bbe7-766027eaeded tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:18.863855 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0dc1b57-8444-4c05-bbe7-766027eaeded tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:18.864262 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-2e7f3f15-f79c-4144-a3b9-a4204ec57e06 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:18.865195 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0dc1b57-8444-4c05-bbe7-766027eaeded tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:18.865828 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-2e7f3f15-f79c-4144-a3b9-a4204ec57e06 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:18.878584 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2e7f3f15-f79c-4144-a3b9-a4204ec57e06 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:18.880343 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2e7f3f15-f79c-4144-a3b9-a4204ec57e06 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:18.881694 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2e7f3f15-f79c-4144-a3b9-a4204ec57e06 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:18.882486 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2e7f3f15-f79c-4144-a3b9-a4204ec57e06 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:18.967286 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b0dc1b57-8444-4c05-bbe7-766027eaeded tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 14 microversion: 2.20 time: 0.117187 Jan 18 20:24:18.968378 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 107/202] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:18 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:19.017186 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2e7f3f15-f79c-4144-a3b9-a4204ec57e06 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 12803 microversion: 2.1 time: 0.169325 Jan 18 20:24:19.017867 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 96/203] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:18 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 12803 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:19.104670 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-209b8c4c-ee5b-499c-a100-a3b67760f7e5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:19.105727 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-209b8c4c-ee5b-499c-a100-a3b67760f7e5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:19.120181 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-209b8c4c-ee5b-499c-a100-a3b67760f7e5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:19.120974 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-209b8c4c-ee5b-499c-a100-a3b67760f7e5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:19.122367 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-209b8c4c-ee5b-499c-a100-a3b67760f7e5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:19.123188 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-209b8c4c-ee5b-499c-a100-a3b67760f7e5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:19.164656 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-656d3ca8-b234-4d1b-b764-8e61e56f356f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:19.167023 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-656d3ca8-b234-4d1b-b764-8e61e56f356f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:19.181500 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-656d3ca8-b234-4d1b-b764-8e61e56f356f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:19.183024 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-656d3ca8-b234-4d1b-b764-8e61e56f356f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:19.184844 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-656d3ca8-b234-4d1b-b764-8e61e56f356f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:19.185715 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-656d3ca8-b234-4d1b-b764-8e61e56f356f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:19.314387 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-209b8c4c-ee5b-499c-a100-a3b67760f7e5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:19.327844 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-209b8c4c-ee5b-499c-a100-a3b67760f7e5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1318 microversion: 2.1 time: 0.230674 Jan 18 20:24:19.328914 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 108/204] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:19 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:19.439244 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-656d3ca8-b234-4d1b-b764-8e61e56f356f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:19.448438 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-656d3ca8-b234-4d1b-b764-8e61e56f356f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.291752 Jan 18 20:24:19.459477 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 97/205] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:19 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:19.988057 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-51c3db37-46e4-4bfa-9e3d-e377d7c78d50 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:19.992144 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-51c3db37-46e4-4bfa-9e3d-e377d7c78d50 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:20.008201 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-51c3db37-46e4-4bfa-9e3d-e377d7c78d50 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:20.010450 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-51c3db37-46e4-4bfa-9e3d-e377d7c78d50 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:20.012369 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-51c3db37-46e4-4bfa-9e3d-e377d7c78d50 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:20.013380 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-51c3db37-46e4-4bfa-9e3d-e377d7c78d50 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:20.033849 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-c9335582-f781-4d9e-949f-e581e893060b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:20.035629 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-c9335582-f781-4d9e-949f-e581e893060b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:20.055385 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c9335582-f781-4d9e-949f-e581e893060b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:20.056885 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c9335582-f781-4d9e-949f-e581e893060b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:20.059180 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c9335582-f781-4d9e-949f-e581e893060b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:20.060407 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c9335582-f781-4d9e-949f-e581e893060b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:20.162325 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-51c3db37-46e4-4bfa-9e3d-e377d7c78d50 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 14 microversion: 2.20 time: 0.183531 Jan 18 20:24:20.163849 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 109/206] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:19 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:20.175152 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-303701ab-09d1-4121-a8de-bacb889f8353 req-d04c566b-ddf9-4351-89a2-68f3b57dfc5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7866fc9-233f-4a31-85ae-87b6b5cf9474", "name": "network-vif-plugged", "status": "completed", "tag": "8e771083-6f01-41a0-aae7-67a33901263a"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:20.179538 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:24:20.179538 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:24:20.194840 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-303701ab-09d1-4121-a8de-bacb889f8353 req-d04c566b-ddf9-4351-89a2-68f3b57dfc5d service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:20.195683 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-303701ab-09d1-4121-a8de-bacb889f8353 req-d04c566b-ddf9-4351-89a2-68f3b57dfc5d service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:20.206949 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-c9335582-f781-4d9e-949f-e581e893060b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 16235 microversion: 2.1 time: 0.178839 Jan 18 20:24:20.209354 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 98/207] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:20 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 16235 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:20.240320 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-303701ab-09d1-4121-a8de-bacb889f8353 req-d04c566b-ddf9-4351-89a2-68f3b57dfc5d service nova] Creating event network-vif-plugged:8e771083-6f01-41a0-aae7-67a33901263a for instance c7866fc9-233f-4a31-85ae-87b6b5cf9474 on hv-cinder-82160 Jan 18 20:24:20.259958 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-303701ab-09d1-4121-a8de-bacb889f8353 req-d04c566b-ddf9-4351-89a2-68f3b57dfc5d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093260 Jan 18 20:24:20.262194 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 110/208] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:24:20.366669 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-15ef5025-9a5e-423a-9775-ad8ed3511d17 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:20.367971 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-15ef5025-9a5e-423a-9775-ad8ed3511d17 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:20.400501 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-15ef5025-9a5e-423a-9775-ad8ed3511d17 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:20.401279 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-15ef5025-9a5e-423a-9775-ad8ed3511d17 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:20.402895 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-15ef5025-9a5e-423a-9775-ad8ed3511d17 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:20.405726 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-15ef5025-9a5e-423a-9775-ad8ed3511d17 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:20.473620 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fd0dae1a-d680-4967-82cf-a6c64f08a161 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:20.474120 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fd0dae1a-d680-4967-82cf-a6c64f08a161 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:20.507964 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fd0dae1a-d680-4967-82cf-a6c64f08a161 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:20.508744 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fd0dae1a-d680-4967-82cf-a6c64f08a161 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:20.510354 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fd0dae1a-d680-4967-82cf-a6c64f08a161 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:20.511432 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fd0dae1a-d680-4967-82cf-a6c64f08a161 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:20.742143 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fd0dae1a-d680-4967-82cf-a6c64f08a161 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:20.755526 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fd0dae1a-d680-4967-82cf-a6c64f08a161 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.291510 Jan 18 20:24:20.756488 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 111/209] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:20 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:24:20.778299 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-15ef5025-9a5e-423a-9775-ad8ed3511d17 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:20.789290 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-15ef5025-9a5e-423a-9775-ad8ed3511d17 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1318 microversion: 2.1 time: 0.446899 Jan 18 20:24:20.801703 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 99/210] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:20 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:24:21.176656 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8935f58d-3d3a-42fb-8f65-de8c7cefc49c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:21.178376 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8935f58d-3d3a-42fb-8f65-de8c7cefc49c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:21.186468 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8935f58d-3d3a-42fb-8f65-de8c7cefc49c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:21.187367 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8935f58d-3d3a-42fb-8f65-de8c7cefc49c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:21.188187 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8935f58d-3d3a-42fb-8f65-de8c7cefc49c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:21.188781 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8935f58d-3d3a-42fb-8f65-de8c7cefc49c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:21.220307 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7c42518a-89c8-4df1-95e1-a8b18910bccf tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:21.223964 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-7c42518a-89c8-4df1-95e1-a8b18910bccf tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:21.235989 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7c42518a-89c8-4df1-95e1-a8b18910bccf tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:21.237386 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7c42518a-89c8-4df1-95e1-a8b18910bccf tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:21.239789 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7c42518a-89c8-4df1-95e1-a8b18910bccf tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:21.240683 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7c42518a-89c8-4df1-95e1-a8b18910bccf tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:21.301565 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8935f58d-3d3a-42fb-8f65-de8c7cefc49c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 3519 microversion: 2.20 time: 0.128730 Jan 18 20:24:21.302233 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 112/211] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:21 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 3519 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:24:21.341687 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7c42518a-89c8-4df1-95e1-a8b18910bccf tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 17931 microversion: 2.1 time: 0.125128 Jan 18 20:24:21.342935 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 100/212] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:21 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 17931 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:21.786359 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-df768e39-f4f1-42a7-8069-176acab0a936 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:21.787735 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-df768e39-f4f1-42a7-8069-176acab0a936 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:21.796810 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df768e39-f4f1-42a7-8069-176acab0a936 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:21.797443 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df768e39-f4f1-42a7-8069-176acab0a936 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:21.798454 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df768e39-f4f1-42a7-8069-176acab0a936 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:21.799060 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df768e39-f4f1-42a7-8069-176acab0a936 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:21.812361 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-61b6c618-9b4c-42d0-9332-8a7d07d4fe36 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:21.813762 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-61b6c618-9b4c-42d0-9332-8a7d07d4fe36 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:21.827879 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-61b6c618-9b4c-42d0-9332-8a7d07d4fe36 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:21.829264 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-61b6c618-9b4c-42d0-9332-8a7d07d4fe36 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:21.831221 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-61b6c618-9b4c-42d0-9332-8a7d07d4fe36 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:21.834916 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-61b6c618-9b4c-42d0-9332-8a7d07d4fe36 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:21.967605 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-df768e39-f4f1-42a7-8069-176acab0a936 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:21.983876 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-df768e39-f4f1-42a7-8069-176acab0a936 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.203462 Jan 18 20:24:21.985249 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 113/213] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:21 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:22.108317 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-61b6c618-9b4c-42d0-9332-8a7d07d4fe36 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:22.118542 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-61b6c618-9b4c-42d0-9332-8a7d07d4fe36 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1318 microversion: 2.1 time: 0.312979 Jan 18 20:24:22.119483 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 101/214] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:21 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:22.314584 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-05bdbc79-a1ed-49e1-af32-d3213fa917fc tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:22.315579 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-05bdbc79-a1ed-49e1-af32-d3213fa917fc tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:22.324250 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05bdbc79-a1ed-49e1-af32-d3213fa917fc tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:22.325027 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05bdbc79-a1ed-49e1-af32-d3213fa917fc tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:22.326400 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05bdbc79-a1ed-49e1-af32-d3213fa917fc tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:22.326889 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05bdbc79-a1ed-49e1-af32-d3213fa917fc tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:22.355855 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-815fa9fb-4ac7-4239-874e-297cc1ceda9f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:22.357512 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-815fa9fb-4ac7-4239-874e-297cc1ceda9f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:22.366267 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-815fa9fb-4ac7-4239-874e-297cc1ceda9f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:22.366734 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-815fa9fb-4ac7-4239-874e-297cc1ceda9f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:22.367583 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-815fa9fb-4ac7-4239-874e-297cc1ceda9f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:22.368025 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-815fa9fb-4ac7-4239-874e-297cc1ceda9f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:22.440771 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-05bdbc79-a1ed-49e1-af32-d3213fa917fc tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 8267 microversion: 2.20 time: 0.130355 Jan 18 20:24:22.441942 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 114/215] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:22 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 8267 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:24:22.490214 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-815fa9fb-4ac7-4239-874e-297cc1ceda9f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 18871 microversion: 2.1 time: 0.136959 Jan 18 20:24:22.492388 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 102/216] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:22 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 18871 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:24:23.012927 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3d0bfec8-98cd-4a17-81e5-322dcbf231fb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:23.013647 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3d0bfec8-98cd-4a17-81e5-322dcbf231fb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:23.022976 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3d0bfec8-98cd-4a17-81e5-322dcbf231fb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:23.023565 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3d0bfec8-98cd-4a17-81e5-322dcbf231fb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:23.024642 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3d0bfec8-98cd-4a17-81e5-322dcbf231fb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:23.025417 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3d0bfec8-98cd-4a17-81e5-322dcbf231fb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:23.142964 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-199baae8-ab25-4555-b39f-8b5b0d98bef6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:23.143701 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-199baae8-ab25-4555-b39f-8b5b0d98bef6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:23.152566 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-199baae8-ab25-4555-b39f-8b5b0d98bef6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:23.153356 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-199baae8-ab25-4555-b39f-8b5b0d98bef6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:23.154253 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-199baae8-ab25-4555-b39f-8b5b0d98bef6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:23.154941 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-199baae8-ab25-4555-b39f-8b5b0d98bef6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:23.234614 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3d0bfec8-98cd-4a17-81e5-322dcbf231fb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:23.246487 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3d0bfec8-98cd-4a17-81e5-322dcbf231fb tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.238283 Jan 18 20:24:23.258515 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 115/217] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:23 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:24:23.355805 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-199baae8-ab25-4555-b39f-8b5b0d98bef6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:23.366892 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-199baae8-ab25-4555-b39f-8b5b0d98bef6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1507 microversion: 2.1 time: 0.227569 Jan 18 20:24:23.368229 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 103/218] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:23 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1507 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:23.387700 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f776830c-d864-45e4-bf98-4944fe21bb2a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e203a156-1197-49d2-8e91-6052c655106a"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:23.389230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f776830c-d864-45e4-bf98-4944fe21bb2a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:23.398095 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f776830c-d864-45e4-bf98-4944fe21bb2a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:23.398831 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f776830c-d864-45e4-bf98-4944fe21bb2a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:23.399864 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f776830c-d864-45e4-bf98-4944fe21bb2a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:23.400577 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f776830c-d864-45e4-bf98-4944fe21bb2a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:23.456325 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d84de134-b74b-4ec7-bf2f-8fbf1facddcd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:23.457645 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d84de134-b74b-4ec7-bf2f-8fbf1facddcd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:23.465927 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d84de134-b74b-4ec7-bf2f-8fbf1facddcd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:23.466379 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d84de134-b74b-4ec7-bf2f-8fbf1facddcd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:23.467293 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d84de134-b74b-4ec7-bf2f-8fbf1facddcd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:23.467951 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d84de134-b74b-4ec7-bf2f-8fbf1facddcd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:23.537334 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-f776830c-d864-45e4-bf98-4944fe21bb2a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] HTTP exception thrown: Invalid volume: volume e203a156-1197-49d2-8e91-6052c655106a is already attached to instances: 46334d7f-6fa1-41ba-bc9d-a80684750c70 Jan 18 20:24:23.537962 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f776830c-d864-45e4-bf98-4944fe21bb2a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Returning 400 to user: Invalid volume: volume e203a156-1197-49d2-8e91-6052c655106a is already attached to instances: 46334d7f-6fa1-41ba-bc9d-a80684750c70 {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:24:23.538822 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f776830c-d864-45e4-bf98-4944fe21bb2a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "POST /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.157041 Jan 18 20:24:23.539486 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 116/219] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Jan 18 20:24:23 2022] POST /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474/os-volume_attachments => generated 174 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 18 20:24:23.544595 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2bf8fda9-277c-4a90-93e5-3bada7883c37 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:23.546131 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2bf8fda9-277c-4a90-93e5-3bada7883c37 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:23.557584 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bf8fda9-277c-4a90-93e5-3bada7883c37 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:23.558320 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bf8fda9-277c-4a90-93e5-3bada7883c37 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:23.559648 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bf8fda9-277c-4a90-93e5-3bada7883c37 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:23.560524 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bf8fda9-277c-4a90-93e5-3bada7883c37 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:23.615125 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d84de134-b74b-4ec7-bf2f-8fbf1facddcd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 12677 microversion: 2.20 time: 0.161986 Jan 18 20:24:23.619743 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 104/220] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:23 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 12677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:24:23.670986 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7462fc1d-8108-440d-8be5-603066e808f8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:23.672037 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-7462fc1d-8108-440d-8be5-603066e808f8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:23.676062 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2bf8fda9-277c-4a90-93e5-3bada7883c37 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 19616 microversion: 2.1 time: 0.135280 Jan 18 20:24:23.676722 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 117/221] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:23 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 19616 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:23.686539 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7462fc1d-8108-440d-8be5-603066e808f8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:23.687892 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7462fc1d-8108-440d-8be5-603066e808f8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:23.689209 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7462fc1d-8108-440d-8be5-603066e808f8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:23.690330 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7462fc1d-8108-440d-8be5-603066e808f8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:23.968297 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.objects.instance [None req-7462fc1d-8108-440d-8be5-603066e808f8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lazy-loading 'services' on Instance uuid 46334d7f-6fa1-41ba-bc9d-a80684750c70 {{(pid=116376) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:24:24.254857 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7462fc1d-8108-440d-8be5-603066e808f8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "DELETE /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70/os-volume_attachments/e203a156-1197-49d2-8e91-6052c655106a" status: 202 len: 0 microversion: 2.1 time: 0.591017 Jan 18 20:24:24.263698 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 105/222] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Jan 18 20:24:23 2022] DELETE /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70/os-volume_attachments/e203a156-1197-49d2-8e91-6052c655106a => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:24:24.271339 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ae2ef05c-5d0a-46ea-b737-767cb01a8a1f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:24.274945 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-9ebd86ae-06b5-4c92-ba88-cacc84bf5f9e tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:24.276207 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ae2ef05c-5d0a-46ea-b737-767cb01a8a1f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:24.276553 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-9ebd86ae-06b5-4c92-ba88-cacc84bf5f9e tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:24.290757 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9ebd86ae-06b5-4c92-ba88-cacc84bf5f9e tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:24.292853 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9ebd86ae-06b5-4c92-ba88-cacc84bf5f9e tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:24.296109 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9ebd86ae-06b5-4c92-ba88-cacc84bf5f9e tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:24.296678 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9ebd86ae-06b5-4c92-ba88-cacc84bf5f9e tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:24.305479 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ae2ef05c-5d0a-46ea-b737-767cb01a8a1f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:24.306177 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ae2ef05c-5d0a-46ea-b737-767cb01a8a1f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:24.307203 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ae2ef05c-5d0a-46ea-b737-767cb01a8a1f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:24.307796 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ae2ef05c-5d0a-46ea-b737-767cb01a8a1f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:24.354340 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-9ebd86ae-06b5-4c92-ba88-cacc84bf5f9e tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088504 Jan 18 20:24:24.359899 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 106/223] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:24:24 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:24:24.549339 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ae2ef05c-5d0a-46ea-b737-767cb01a8a1f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:24.560191 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ae2ef05c-5d0a-46ea-b737-767cb01a8a1f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.298336 Jan 18 20:24:24.560769 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 118/224] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:24 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:24.627659 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-c4371708-cd49-4fe5-9e37-1d47b5dc9e4d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:24.628656 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-c4371708-cd49-4fe5-9e37-1d47b5dc9e4d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:24.641680 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c4371708-cd49-4fe5-9e37-1d47b5dc9e4d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:24.642127 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c4371708-cd49-4fe5-9e37-1d47b5dc9e4d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:24.643436 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c4371708-cd49-4fe5-9e37-1d47b5dc9e4d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:24.644243 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c4371708-cd49-4fe5-9e37-1d47b5dc9e4d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:24.691963 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-30a0b4dd-a73d-408a-abad-7b1097f83978 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:24.693790 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-30a0b4dd-a73d-408a-abad-7b1097f83978 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:24.703593 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-30a0b4dd-a73d-408a-abad-7b1097f83978 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:24.704417 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-30a0b4dd-a73d-408a-abad-7b1097f83978 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:24.705698 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-30a0b4dd-a73d-408a-abad-7b1097f83978 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:24.706419 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-30a0b4dd-a73d-408a-abad-7b1097f83978 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:24.786475 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-c4371708-cd49-4fe5-9e37-1d47b5dc9e4d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 16486 microversion: 2.20 time: 0.163062 Jan 18 20:24:24.787776 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 107/225] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:24 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 16486 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:24:24.829804 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-30a0b4dd-a73d-408a-abad-7b1097f83978 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 21884 microversion: 2.1 time: 0.144958 Jan 18 20:24:24.831864 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 119/226] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:24 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 21884 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:24:25.369495 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-729e926b-0147-457c-9072-3315c7ef224d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:25.370595 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-729e926b-0147-457c-9072-3315c7ef224d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:25.383194 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-729e926b-0147-457c-9072-3315c7ef224d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:25.383818 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-729e926b-0147-457c-9072-3315c7ef224d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:25.384781 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-729e926b-0147-457c-9072-3315c7ef224d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:25.385404 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-729e926b-0147-457c-9072-3315c7ef224d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:25.454729 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-729e926b-0147-457c-9072-3315c7ef224d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088835 Jan 18 20:24:25.456008 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 108/227] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:24:25 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:24:25.591076 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e1bf3d0f-e7a9-4574-99b7-921ce6e8691b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:25.592646 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e1bf3d0f-e7a9-4574-99b7-921ce6e8691b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:25.615801 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e1bf3d0f-e7a9-4574-99b7-921ce6e8691b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:25.618184 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e1bf3d0f-e7a9-4574-99b7-921ce6e8691b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:25.620772 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e1bf3d0f-e7a9-4574-99b7-921ce6e8691b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:25.621926 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e1bf3d0f-e7a9-4574-99b7-921ce6e8691b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:25.800181 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-454f0d23-5dd9-4ddb-b053-4819054dc08b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:25.801216 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-454f0d23-5dd9-4ddb-b053-4819054dc08b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:25.809999 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-454f0d23-5dd9-4ddb-b053-4819054dc08b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:25.810695 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-454f0d23-5dd9-4ddb-b053-4819054dc08b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:25.811700 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-454f0d23-5dd9-4ddb-b053-4819054dc08b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:25.812327 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-454f0d23-5dd9-4ddb-b053-4819054dc08b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:25.940152 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-454f0d23-5dd9-4ddb-b053-4819054dc08b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 17861 microversion: 2.20 time: 0.143382 Jan 18 20:24:25.941983 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 109/228] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:25 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 17861 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:24:25.950929 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-19a569a0-3c69-4f83-b1a5-09f8b7f391a9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:25.952454 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-19a569a0-3c69-4f83-b1a5-09f8b7f391a9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:25.994349 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-19a569a0-3c69-4f83-b1a5-09f8b7f391a9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:25.994349 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-19a569a0-3c69-4f83-b1a5-09f8b7f391a9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:25.995328 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-19a569a0-3c69-4f83-b1a5-09f8b7f391a9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:25.995554 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-19a569a0-3c69-4f83-b1a5-09f8b7f391a9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:26.102661 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-19a569a0-3c69-4f83-b1a5-09f8b7f391a9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 23034 microversion: 2.1 time: 0.159062 Jan 18 20:24:26.107103 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 110/229] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:25 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 23034 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:26.117897 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e1bf3d0f-e7a9-4574-99b7-921ce6e8691b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:26.128324 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e1bf3d0f-e7a9-4574-99b7-921ce6e8691b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.552123 Jan 18 20:24:26.129856 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 120/230] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:25 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:24:26.470130 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-6ef9e225-ee94-4c3b-a474-5c8da9210e75 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:26.471775 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-6ef9e225-ee94-4c3b-a474-5c8da9210e75 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:26.480814 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6ef9e225-ee94-4c3b-a474-5c8da9210e75 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:26.481632 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6ef9e225-ee94-4c3b-a474-5c8da9210e75 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:26.482710 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6ef9e225-ee94-4c3b-a474-5c8da9210e75 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:26.483423 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6ef9e225-ee94-4c3b-a474-5c8da9210e75 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:26.532297 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-6ef9e225-ee94-4c3b-a474-5c8da9210e75 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066378 Jan 18 20:24:26.539210 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 111/231] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:24:26 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 18 20:24:26.855765 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a6050e3a-869c-46da-aed7-ce642c2b4904 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-921391792", "imageRef": "c7d259ac-b206-430f-a3c0-794cee408236", "flavorRef": "452", "networks": [{"uuid": "dcb439eb-a130-48e2-8bcd-35ade9b8c9da"}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:26.952303 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-785ecaac-e0b8-4953-acaa-1a7647f50d07 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:26.953230 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-785ecaac-e0b8-4953-acaa-1a7647f50d07 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:26.959857 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-785ecaac-e0b8-4953-acaa-1a7647f50d07 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:26.960302 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-785ecaac-e0b8-4953-acaa-1a7647f50d07 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:26.961099 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-785ecaac-e0b8-4953-acaa-1a7647f50d07 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:26.961530 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-785ecaac-e0b8-4953-acaa-1a7647f50d07 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:26.990364 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-a6050e3a-869c-46da-aed7-ce642c2b4904 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] validate_networks() for [('dcb439eb-a130-48e2-8bcd-35ade9b8c9da', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:24:27.053518 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-785ecaac-e0b8-4953-acaa-1a7647f50d07 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 19342 microversion: 2.20 time: 0.103689 Jan 18 20:24:27.061775 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 112/232] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:26 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 19342 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:24:27.120331 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-cd6b91fd-e0ed-4680-8709-9bc1ae03da96 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:27.122197 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-cd6b91fd-e0ed-4680-8709-9bc1ae03da96 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:27.149759 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cd6b91fd-e0ed-4680-8709-9bc1ae03da96 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:27.150915 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cd6b91fd-e0ed-4680-8709-9bc1ae03da96 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:27.152680 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cd6b91fd-e0ed-4680-8709-9bc1ae03da96 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:27.153735 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cd6b91fd-e0ed-4680-8709-9bc1ae03da96 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:27.291022 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-cd6b91fd-e0ed-4680-8709-9bc1ae03da96 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 23898 microversion: 2.1 time: 0.177993 Jan 18 20:24:27.293113 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 113/233] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:27 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 23898 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:27.306435 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-1cc4b6cf-8a62-4374-8eb6-03fe6caef081 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:27.308209 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-1cc4b6cf-8a62-4374-8eb6-03fe6caef081 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:27.321746 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1cc4b6cf-8a62-4374-8eb6-03fe6caef081 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:27.323230 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1cc4b6cf-8a62-4374-8eb6-03fe6caef081 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:27.327020 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1cc4b6cf-8a62-4374-8eb6-03fe6caef081 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:27.330796 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1cc4b6cf-8a62-4374-8eb6-03fe6caef081 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:27.702191 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-1cc4b6cf-8a62-4374-8eb6-03fe6caef081 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:27.715526 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-1cc4b6cf-8a62-4374-8eb6-03fe6caef081 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.417727 Jan 18 20:24:27.731788 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 114/234] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:27 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:27.735999 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-a6050e3a-869c-46da-aed7-ce642c2b4904 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:24:27.736416 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-a6050e3a-869c-46da-aed7-ce642c2b4904 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:24:27.736885 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-a6050e3a-869c-46da-aed7-ce642c2b4904 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:24:27.737284 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-a6050e3a-869c-46da-aed7-ce642c2b4904 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:24:27.737691 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-a6050e3a-869c-46da-aed7-ce642c2b4904 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:24:27.748801 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a6050e3a-869c-46da-aed7-ce642c2b4904 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:27.749478 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a6050e3a-869c-46da-aed7-ce642c2b4904 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:27.750529 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a6050e3a-869c-46da-aed7-ce642c2b4904 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:27.750932 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a6050e3a-869c-46da-aed7-ce642c2b4904 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:27.790791 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-a6050e3a-869c-46da-aed7-ce642c2b4904 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Getting quotas for project ac7d65640ff94651a7ef1d826ade4cfe. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:24:27.799149 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-a6050e3a-869c-46da-aed7-ce642c2b4904 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Getting quotas for user 6c8a95c08cbe4253b4c279403eeb2bb6 and project ac7d65640ff94651a7ef1d826ade4cfe. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:24:27.831205 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a6050e3a-869c-46da-aed7-ce642c2b4904 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:24:27.838578 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a6050e3a-869c-46da-aed7-ce642c2b4904 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7d259ac-b206-430f-a3c0-794cee408236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:24:27.981267 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a6050e3a-869c-46da-aed7-ce642c2b4904 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.129508 Jan 18 20:24:27.982609 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 121/235] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:24:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 20:24:27.997315 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-6bc976ee-c1ab-4e2e-a4ae-27d56499d60d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:28.000108 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-6bc976ee-c1ab-4e2e-a4ae-27d56499d60d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:28.075517 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7b1a8fcf-870c-4a10-b17c-ffeee0df3430 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:28.082670 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7b1a8fcf-870c-4a10-b17c-ffeee0df3430 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:28.106965 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7b1a8fcf-870c-4a10-b17c-ffeee0df3430 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:28.117161 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7b1a8fcf-870c-4a10-b17c-ffeee0df3430 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:28.119550 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7b1a8fcf-870c-4a10-b17c-ffeee0df3430 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:28.120584 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7b1a8fcf-870c-4a10-b17c-ffeee0df3430 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:28.239099 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-6bc976ee-c1ab-4e2e-a4ae-27d56499d60d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:28.246726 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-6bc976ee-c1ab-4e2e-a4ae-27d56499d60d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 200 len: 1217 microversion: 2.1 time: 0.257527 Jan 18 20:24:28.248002 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 115/236] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:27 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 1217 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:28.296824 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7b1a8fcf-870c-4a10-b17c-ffeee0df3430 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 21282 microversion: 2.20 time: 0.230207 Jan 18 20:24:28.297799 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 122/237] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:28 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 21282 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:24:28.308287 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fe6722c8-8cef-4781-a144-a3b856f9af32 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:28.309517 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-fe6722c8-8cef-4781-a144-a3b856f9af32 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:28.329018 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fe6722c8-8cef-4781-a144-a3b856f9af32 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:28.334122 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fe6722c8-8cef-4781-a144-a3b856f9af32 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:28.336232 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fe6722c8-8cef-4781-a144-a3b856f9af32 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:28.337904 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fe6722c8-8cef-4781-a144-a3b856f9af32 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:28.485709 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-fe6722c8-8cef-4781-a144-a3b856f9af32 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 25039 microversion: 2.1 time: 0.181672 Jan 18 20:24:28.488876 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 116/238] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:28 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 25039 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:28.764985 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1b9100d7-cb31-4e74-8fc2-b46a9031c892 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:28.766936 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1b9100d7-cb31-4e74-8fc2-b46a9031c892 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:28.787502 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b9100d7-cb31-4e74-8fc2-b46a9031c892 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:28.788194 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b9100d7-cb31-4e74-8fc2-b46a9031c892 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:28.789250 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b9100d7-cb31-4e74-8fc2-b46a9031c892 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:28.790012 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b9100d7-cb31-4e74-8fc2-b46a9031c892 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:29.133899 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1b9100d7-cb31-4e74-8fc2-b46a9031c892 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:29.172236 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1b9100d7-cb31-4e74-8fc2-b46a9031c892 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.427245 Jan 18 20:24:29.187968 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 123/239] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:28 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:29.285904 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-9c1178ac-94ed-4afa-98e8-7c0fa722a967 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:29.288388 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-9c1178ac-94ed-4afa-98e8-7c0fa722a967 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:29.318519 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-793a4e6c-06a8-4204-81c6-2941bfef4f2d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:29.319502 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-793a4e6c-06a8-4204-81c6-2941bfef4f2d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:29.328377 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9c1178ac-94ed-4afa-98e8-7c0fa722a967 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:29.328811 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9c1178ac-94ed-4afa-98e8-7c0fa722a967 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:29.329630 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9c1178ac-94ed-4afa-98e8-7c0fa722a967 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:29.330064 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9c1178ac-94ed-4afa-98e8-7c0fa722a967 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:29.339494 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-793a4e6c-06a8-4204-81c6-2941bfef4f2d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:29.340894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-793a4e6c-06a8-4204-81c6-2941bfef4f2d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:29.343187 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-793a4e6c-06a8-4204-81c6-2941bfef4f2d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:29.344076 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-793a4e6c-06a8-4204-81c6-2941bfef4f2d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:29.497940 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-9c1178ac-94ed-4afa-98e8-7c0fa722a967 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:29.507277 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-9c1178ac-94ed-4afa-98e8-7c0fa722a967 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 200 len: 1269 microversion: 2.1 time: 0.233827 Jan 18 20:24:29.508288 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 117/240] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:29 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 1269 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:29.514095 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-994ebb61-eb39-4180-b4ed-b191981294f0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:29.515284 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-994ebb61-eb39-4180-b4ed-b191981294f0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:29.522648 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-793a4e6c-06a8-4204-81c6-2941bfef4f2d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 22845 microversion: 2.20 time: 0.212762 Jan 18 20:24:29.523668 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 124/241] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:29 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 22845 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:24:29.527978 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-994ebb61-eb39-4180-b4ed-b191981294f0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:29.527978 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-994ebb61-eb39-4180-b4ed-b191981294f0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:29.527978 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-994ebb61-eb39-4180-b4ed-b191981294f0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:29.527978 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-994ebb61-eb39-4180-b4ed-b191981294f0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:29.681382 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-994ebb61-eb39-4180-b4ed-b191981294f0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 25804 microversion: 2.1 time: 0.170368 Jan 18 20:24:29.682386 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 118/242] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:29 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 25804 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:30.212827 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2ac2c512-3449-4d58-be62-62532ea5f9cd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:30.217415 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2ac2c512-3449-4d58-be62-62532ea5f9cd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:30.234580 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ac2c512-3449-4d58-be62-62532ea5f9cd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:30.237416 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ac2c512-3449-4d58-be62-62532ea5f9cd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:30.239539 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ac2c512-3449-4d58-be62-62532ea5f9cd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:30.240670 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ac2c512-3449-4d58-be62-62532ea5f9cd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:30.459944 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2ac2c512-3449-4d58-be62-62532ea5f9cd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:30.469644 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2ac2c512-3449-4d58-be62-62532ea5f9cd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.270851 Jan 18 20:24:30.470551 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 125/243] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:30 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:30.529341 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d9ba07aa-b5c3-4868-9eb0-911d1a7c485a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:30.530596 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d9ba07aa-b5c3-4868-9eb0-911d1a7c485a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:30.535539 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3916dba8-1bfd-40b7-9e98-ffb447efd6d4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:30.536432 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3916dba8-1bfd-40b7-9e98-ffb447efd6d4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:30.543144 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d9ba07aa-b5c3-4868-9eb0-911d1a7c485a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:30.544076 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d9ba07aa-b5c3-4868-9eb0-911d1a7c485a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:30.545663 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d9ba07aa-b5c3-4868-9eb0-911d1a7c485a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:30.546529 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d9ba07aa-b5c3-4868-9eb0-911d1a7c485a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:30.551069 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3916dba8-1bfd-40b7-9e98-ffb447efd6d4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:30.553265 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3916dba8-1bfd-40b7-9e98-ffb447efd6d4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:30.555170 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3916dba8-1bfd-40b7-9e98-ffb447efd6d4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:30.555829 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3916dba8-1bfd-40b7-9e98-ffb447efd6d4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:30.663942 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3916dba8-1bfd-40b7-9e98-ffb447efd6d4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 23796 microversion: 2.20 time: 0.133410 Jan 18 20:24:30.668837 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 126/244] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:30 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 23796 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:24:30.697506 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-eff94ec2-9fa6-4cd4-a1c5-f55ee639467e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:30.699230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-eff94ec2-9fa6-4cd4-a1c5-f55ee639467e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:30.714349 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eff94ec2-9fa6-4cd4-a1c5-f55ee639467e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:30.718480 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eff94ec2-9fa6-4cd4-a1c5-f55ee639467e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:30.721958 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eff94ec2-9fa6-4cd4-a1c5-f55ee639467e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:30.722463 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eff94ec2-9fa6-4cd4-a1c5-f55ee639467e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:30.877616 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-eff94ec2-9fa6-4cd4-a1c5-f55ee639467e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 26433 microversion: 2.1 time: 0.184140 Jan 18 20:24:30.879868 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 127/245] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:30 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 26433 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:24:30.889176 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d9ba07aa-b5c3-4868-9eb0-911d1a7c485a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:30.900570 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d9ba07aa-b5c3-4868-9eb0-911d1a7c485a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 200 len: 1317 microversion: 2.1 time: 0.378223 Jan 18 20:24:30.901478 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 119/246] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:30 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:31.486824 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b630c87b-da85-438e-893c-50910ca5ac79 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:31.487652 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b630c87b-da85-438e-893c-50910ca5ac79 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:31.495324 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b630c87b-da85-438e-893c-50910ca5ac79 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:31.495861 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b630c87b-da85-438e-893c-50910ca5ac79 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:31.496759 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b630c87b-da85-438e-893c-50910ca5ac79 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:31.497271 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b630c87b-da85-438e-893c-50910ca5ac79 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:31.668363 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b630c87b-da85-438e-893c-50910ca5ac79 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:31.692184 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a7311921-3c1c-4ffc-8149-4297df8f5422 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:31.699726 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-a7311921-3c1c-4ffc-8149-4297df8f5422 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:31.709256 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b630c87b-da85-438e-893c-50910ca5ac79 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.226456 Jan 18 20:24:31.709851 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 128/247] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:31 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:31.734283 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a7311921-3c1c-4ffc-8149-4297df8f5422 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:31.735229 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a7311921-3c1c-4ffc-8149-4297df8f5422 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:31.738119 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a7311921-3c1c-4ffc-8149-4297df8f5422 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:31.738768 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a7311921-3c1c-4ffc-8149-4297df8f5422 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:31.862532 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a7311921-3c1c-4ffc-8149-4297df8f5422 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 24464 microversion: 2.20 time: 0.183265 Jan 18 20:24:31.864266 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 120/248] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:31 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 24464 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:24:31.934825 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-cb829233-246b-4f4c-b9e2-c13bdea4bae2 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:31.937483 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4e2c4d65-7dea-4f64-bac9-312d8e021960 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:31.941639 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-cb829233-246b-4f4c-b9e2-c13bdea4bae2 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:31.942305 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4e2c4d65-7dea-4f64-bac9-312d8e021960 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:31.967331 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4e2c4d65-7dea-4f64-bac9-312d8e021960 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:31.971088 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4e2c4d65-7dea-4f64-bac9-312d8e021960 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:31.974129 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4e2c4d65-7dea-4f64-bac9-312d8e021960 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:31.975502 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cb829233-246b-4f4c-b9e2-c13bdea4bae2 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:31.976574 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cb829233-246b-4f4c-b9e2-c13bdea4bae2 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:31.977480 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4e2c4d65-7dea-4f64-bac9-312d8e021960 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:32.008501 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cb829233-246b-4f4c-b9e2-c13bdea4bae2 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:32.008501 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cb829233-246b-4f4c-b9e2-c13bdea4bae2 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:32.188018 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4e2c4d65-7dea-4f64-bac9-312d8e021960 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 26955 microversion: 2.1 time: 0.298315 Jan 18 20:24:32.190611 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 129/249] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:31 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 26955 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:32.201801 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-f9f5c61d-708d-4e03-8c4f-62f3c4fad91a req-ea0384f2-9834-448e-b466-65fe61301854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00", "tag": "f2f1aac5-1110-4e24-863b-979ce59260f2"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:32.204179 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:24:32.204179 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:24:32.214223 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-f9f5c61d-708d-4e03-8c4f-62f3c4fad91a req-ea0384f2-9834-448e-b466-65fe61301854 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:32.214767 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-f9f5c61d-708d-4e03-8c4f-62f3c4fad91a req-ea0384f2-9834-448e-b466-65fe61301854 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:32.247424 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-f9f5c61d-708d-4e03-8c4f-62f3c4fad91a req-ea0384f2-9834-448e-b466-65fe61301854 service nova] Creating event network-changed:f2f1aac5-1110-4e24-863b-979ce59260f2 for instance f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 on hv-cinder-82160 Jan 18 20:24:32.254570 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-f9f5c61d-708d-4e03-8c4f-62f3c4fad91a req-ea0384f2-9834-448e-b466-65fe61301854 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060050 Jan 18 20:24:32.255608 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 130/250] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:24:32.440850 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-cb829233-246b-4f4c-b9e2-c13bdea4bae2 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:32.451534 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-cb829233-246b-4f4c-b9e2-c13bdea4bae2 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 200 len: 1317 microversion: 2.1 time: 0.533538 Jan 18 20:24:32.467656 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 121/251] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:31 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:32.745231 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b495fb09-1c05-4a39-86b2-adc65195de3f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:32.748477 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b495fb09-1c05-4a39-86b2-adc65195de3f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:32.786056 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b495fb09-1c05-4a39-86b2-adc65195de3f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:32.787232 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b495fb09-1c05-4a39-86b2-adc65195de3f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:32.788591 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b495fb09-1c05-4a39-86b2-adc65195de3f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:32.789570 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b495fb09-1c05-4a39-86b2-adc65195de3f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:32.880375 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-383c1499-9a99-481d-9881-2658adca7e1c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:32.881317 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-383c1499-9a99-481d-9881-2658adca7e1c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:32.888893 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-383c1499-9a99-481d-9881-2658adca7e1c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:32.889335 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-383c1499-9a99-481d-9881-2658adca7e1c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:32.890128 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-383c1499-9a99-481d-9881-2658adca7e1c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:32.890587 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-383c1499-9a99-481d-9881-2658adca7e1c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:33.041061 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-383c1499-9a99-481d-9881-2658adca7e1c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 25328 microversion: 2.20 time: 0.167761 Jan 18 20:24:33.041737 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b495fb09-1c05-4a39-86b2-adc65195de3f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:33.042529 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 122/252] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:32 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 25328 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:24:33.053836 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b495fb09-1c05-4a39-86b2-adc65195de3f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.317259 Jan 18 20:24:33.061709 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 131/253] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:32 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:33.206322 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a115e5da-ee03-4750-a588-9df096529a67 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:33.207819 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-a115e5da-ee03-4750-a588-9df096529a67 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:33.216944 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a115e5da-ee03-4750-a588-9df096529a67 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:33.217977 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a115e5da-ee03-4750-a588-9df096529a67 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:33.218946 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a115e5da-ee03-4750-a588-9df096529a67 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:33.219618 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a115e5da-ee03-4750-a588-9df096529a67 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:33.346546 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a115e5da-ee03-4750-a588-9df096529a67 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 27394 microversion: 2.1 time: 0.144777 Jan 18 20:24:33.351685 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 123/254] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:33 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 27394 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:24:33.469391 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1b63eabe-4596-4d07-8ecd-4af3cbac0197 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:33.470294 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1b63eabe-4596-4d07-8ecd-4af3cbac0197 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:33.477673 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b63eabe-4596-4d07-8ecd-4af3cbac0197 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:33.478122 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b63eabe-4596-4d07-8ecd-4af3cbac0197 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:33.479011 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b63eabe-4596-4d07-8ecd-4af3cbac0197 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:33.480218 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b63eabe-4596-4d07-8ecd-4af3cbac0197 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:33.627706 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1b63eabe-4596-4d07-8ecd-4af3cbac0197 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:33.636986 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1b63eabe-4596-4d07-8ecd-4af3cbac0197 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 200 len: 1317 microversion: 2.1 time: 0.171442 Jan 18 20:24:33.637588 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 132/255] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:33 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:34.057350 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4c763bd9-b1b3-4519-9f67-35d39d61ebe6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:34.058398 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-4c763bd9-b1b3-4519-9f67-35d39d61ebe6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:34.066275 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4c763bd9-b1b3-4519-9f67-35d39d61ebe6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:34.066939 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4c763bd9-b1b3-4519-9f67-35d39d61ebe6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:34.070243 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4c763bd9-b1b3-4519-9f67-35d39d61ebe6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:34.070243 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4c763bd9-b1b3-4519-9f67-35d39d61ebe6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:34.077183 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bfd6e7fa-1f40-427b-af12-198559ebce9a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:34.078069 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bfd6e7fa-1f40-427b-af12-198559ebce9a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:34.093085 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bfd6e7fa-1f40-427b-af12-198559ebce9a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:34.093538 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bfd6e7fa-1f40-427b-af12-198559ebce9a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:34.095622 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bfd6e7fa-1f40-427b-af12-198559ebce9a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:34.097765 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bfd6e7fa-1f40-427b-af12-198559ebce9a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:34.189195 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-4c763bd9-b1b3-4519-9f67-35d39d61ebe6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 26004 microversion: 2.20 time: 0.135868 Jan 18 20:24:34.191702 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 124/256] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:34 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 26004 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:24:34.307468 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bfd6e7fa-1f40-427b-af12-198559ebce9a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:34.323957 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bfd6e7fa-1f40-427b-af12-198559ebce9a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.251932 Jan 18 20:24:34.327173 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 133/257] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:34 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:34.363832 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fc994786-2e4a-42ee-bcf8-829587f1e052 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:34.365255 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-fc994786-2e4a-42ee-bcf8-829587f1e052 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:34.374995 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fc994786-2e4a-42ee-bcf8-829587f1e052 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:34.375766 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fc994786-2e4a-42ee-bcf8-829587f1e052 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:34.376891 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fc994786-2e4a-42ee-bcf8-829587f1e052 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:34.377541 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fc994786-2e4a-42ee-bcf8-829587f1e052 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:34.657505 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5bf4ae71-9681-436b-9e1b-2a618186c70d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:34.658534 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5bf4ae71-9681-436b-9e1b-2a618186c70d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:34.675460 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5bf4ae71-9681-436b-9e1b-2a618186c70d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:34.676253 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5bf4ae71-9681-436b-9e1b-2a618186c70d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:34.677427 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5bf4ae71-9681-436b-9e1b-2a618186c70d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:34.678067 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5bf4ae71-9681-436b-9e1b-2a618186c70d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:34.892837 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5bf4ae71-9681-436b-9e1b-2a618186c70d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:34.901421 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5bf4ae71-9681-436b-9e1b-2a618186c70d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 200 len: 1317 microversion: 2.1 time: 0.250911 Jan 18 20:24:34.902007 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 134/258] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:34 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:35.206791 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8aef054d-1b67-488d-bb84-452757b93929 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:35.208433 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8aef054d-1b67-488d-bb84-452757b93929 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:35.218054 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8aef054d-1b67-488d-bb84-452757b93929 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:35.218495 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8aef054d-1b67-488d-bb84-452757b93929 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:35.219361 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8aef054d-1b67-488d-bb84-452757b93929 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:35.219820 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8aef054d-1b67-488d-bb84-452757b93929 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:37.359347 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-fc994786-2e4a-42ee-bcf8-829587f1e052 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 27819 microversion: 2.1 time: 3.001729 Jan 18 20:24:37.359923 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 125/259] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:34 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 27819 bytes in 3004 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:37.366070 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-36d0ebb2-646c-445a-8fd4-08c56e16de7e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:37.366786 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-36d0ebb2-646c-445a-8fd4-08c56e16de7e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:37.375387 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-36d0ebb2-646c-445a-8fd4-08c56e16de7e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:37.375830 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-36d0ebb2-646c-445a-8fd4-08c56e16de7e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:37.376775 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-36d0ebb2-646c-445a-8fd4-08c56e16de7e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:37.377203 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-36d0ebb2-646c-445a-8fd4-08c56e16de7e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:37.415186 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8aef054d-1b67-488d-bb84-452757b93929 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 27633 microversion: 2.20 time: 2.215976 Jan 18 20:24:37.416574 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 135/260] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:35 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 27633 bytes in 2219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:24:37.424386 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d72094e9-d06f-4366-8da7-96cef0859bfb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:37.425963 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d72094e9-d06f-4366-8da7-96cef0859bfb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:37.438590 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d72094e9-d06f-4366-8da7-96cef0859bfb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:37.439475 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d72094e9-d06f-4366-8da7-96cef0859bfb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:37.440902 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d72094e9-d06f-4366-8da7-96cef0859bfb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:37.441727 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d72094e9-d06f-4366-8da7-96cef0859bfb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:37.541856 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-36d0ebb2-646c-445a-8fd4-08c56e16de7e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:37.557015 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-36d0ebb2-646c-445a-8fd4-08c56e16de7e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.195319 Jan 18 20:24:37.558126 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 126/261] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:37 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:37.624242 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d72094e9-d06f-4366-8da7-96cef0859bfb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:37.633252 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d72094e9-d06f-4366-8da7-96cef0859bfb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 200 len: 1317 microversion: 2.1 time: 0.215014 Jan 18 20:24:37.633857 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 136/262] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:37 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:38.383048 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0164cd68-722c-419d-a351-b6f43a7eacd2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:38.384707 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0164cd68-722c-419d-a351-b6f43a7eacd2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:38.407248 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0164cd68-722c-419d-a351-b6f43a7eacd2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:38.407699 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0164cd68-722c-419d-a351-b6f43a7eacd2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:38.408579 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0164cd68-722c-419d-a351-b6f43a7eacd2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:38.409075 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0164cd68-722c-419d-a351-b6f43a7eacd2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:38.434967 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-cbc7b6fc-5996-4699-a843-4e693ed7e1a6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:38.436993 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-cbc7b6fc-5996-4699-a843-4e693ed7e1a6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:38.445080 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cbc7b6fc-5996-4699-a843-4e693ed7e1a6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:38.445436 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cbc7b6fc-5996-4699-a843-4e693ed7e1a6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:38.446631 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cbc7b6fc-5996-4699-a843-4e693ed7e1a6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:38.447174 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cbc7b6fc-5996-4699-a843-4e693ed7e1a6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:38.518254 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0164cd68-722c-419d-a351-b6f43a7eacd2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28172 microversion: 2.1 time: 0.148659 Jan 18 20:24:38.520042 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 127/263] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:38 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28172 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:24:38.563615 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-cbc7b6fc-5996-4699-a843-4e693ed7e1a6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 27956 microversion: 2.20 time: 0.134106 Jan 18 20:24:38.564534 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 137/264] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:38 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 27956 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:24:38.585447 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-9ad549dc-84c8-4258-9e76-8fc60106c1e7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:38.586188 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-9ad549dc-84c8-4258-9e76-8fc60106c1e7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:38.594729 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9ad549dc-84c8-4258-9e76-8fc60106c1e7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:38.595212 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9ad549dc-84c8-4258-9e76-8fc60106c1e7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:38.596230 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9ad549dc-84c8-4258-9e76-8fc60106c1e7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:38.596832 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9ad549dc-84c8-4258-9e76-8fc60106c1e7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:38.650876 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c97bfed1-d104-42bc-8ab4-ed079054aee8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:38.652072 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c97bfed1-d104-42bc-8ab4-ed079054aee8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:38.659787 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c97bfed1-d104-42bc-8ab4-ed079054aee8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:38.660247 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c97bfed1-d104-42bc-8ab4-ed079054aee8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:38.661137 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c97bfed1-d104-42bc-8ab4-ed079054aee8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:38.661575 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c97bfed1-d104-42bc-8ab4-ed079054aee8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:38.777186 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-9ad549dc-84c8-4258-9e76-8fc60106c1e7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:38.786569 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-9ad549dc-84c8-4258-9e76-8fc60106c1e7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.206506 Jan 18 20:24:38.787316 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 128/265] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:38 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:38.810374 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c97bfed1-d104-42bc-8ab4-ed079054aee8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:38.818320 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c97bfed1-d104-42bc-8ab4-ed079054aee8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 200 len: 1317 microversion: 2.1 time: 0.171638 Jan 18 20:24:38.818884 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 138/266] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:38 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:39.531377 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f14787ae-b819-493a-b53c-93dbf0bbab2c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:39.532306 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-f14787ae-b819-493a-b53c-93dbf0bbab2c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:39.539607 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f14787ae-b819-493a-b53c-93dbf0bbab2c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:39.540051 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f14787ae-b819-493a-b53c-93dbf0bbab2c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:39.540989 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f14787ae-b819-493a-b53c-93dbf0bbab2c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:39.541422 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f14787ae-b819-493a-b53c-93dbf0bbab2c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:39.579700 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-efe34ddb-fcca-42f8-a436-b12773b0017e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:39.581868 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-efe34ddb-fcca-42f8-a436-b12773b0017e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:39.596437 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-efe34ddb-fcca-42f8-a436-b12773b0017e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:39.597461 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-efe34ddb-fcca-42f8-a436-b12773b0017e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:39.598259 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-efe34ddb-fcca-42f8-a436-b12773b0017e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:39.598693 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-efe34ddb-fcca-42f8-a436-b12773b0017e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:41.734777 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-f14787ae-b819-493a-b53c-93dbf0bbab2c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28172 microversion: 2.1 time: 2.206835 Jan 18 20:24:41.736478 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 129/267] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:39 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28172 bytes in 2209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:41.741673 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d4482649-7323-4d71-b1be-4b04d1326eff tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:41.742362 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d4482649-7323-4d71-b1be-4b04d1326eff tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:41.750399 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d4482649-7323-4d71-b1be-4b04d1326eff tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:41.750847 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d4482649-7323-4d71-b1be-4b04d1326eff tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:41.751674 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d4482649-7323-4d71-b1be-4b04d1326eff tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:41.752109 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d4482649-7323-4d71-b1be-4b04d1326eff tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:41.769647 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-efe34ddb-fcca-42f8-a436-b12773b0017e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 28025 microversion: 2.20 time: 2.193973 Jan 18 20:24:41.776046 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 139/268] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:39 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 28025 bytes in 2197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:24:41.779164 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a86aa40a-5621-4261-9596-fb9c0598e9d8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:41.780356 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a86aa40a-5621-4261-9596-fb9c0598e9d8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:41.793922 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a86aa40a-5621-4261-9596-fb9c0598e9d8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:41.794903 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a86aa40a-5621-4261-9596-fb9c0598e9d8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:41.796169 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a86aa40a-5621-4261-9596-fb9c0598e9d8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:41.796789 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a86aa40a-5621-4261-9596-fb9c0598e9d8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:41.949378 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d4482649-7323-4d71-b1be-4b04d1326eff tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:41.963058 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d4482649-7323-4d71-b1be-4b04d1326eff tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.225044 Jan 18 20:24:41.964379 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 130/269] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:41 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:41.988820 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a86aa40a-5621-4261-9596-fb9c0598e9d8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:42.002789 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a86aa40a-5621-4261-9596-fb9c0598e9d8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 200 len: 1317 microversion: 2.1 time: 0.229840 Jan 18 20:24:42.004443 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 140/270] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:41 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:42.193759 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-f42cb405-fb7f-4973-993c-7dea9ec23b97 req-5e30692d-1eef-4da4-8740-7fdeffbd20a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00", "name": "network-vif-plugged", "status": "completed", "tag": "f2f1aac5-1110-4e24-863b-979ce59260f2"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:42.196007 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:24:42.196007 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:24:42.204672 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-f42cb405-fb7f-4973-993c-7dea9ec23b97 req-5e30692d-1eef-4da4-8740-7fdeffbd20a8 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:42.205173 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-f42cb405-fb7f-4973-993c-7dea9ec23b97 req-5e30692d-1eef-4da4-8740-7fdeffbd20a8 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:42.221585 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-f42cb405-fb7f-4973-993c-7dea9ec23b97 req-5e30692d-1eef-4da4-8740-7fdeffbd20a8 service nova] Creating event network-vif-plugged:f2f1aac5-1110-4e24-863b-979ce59260f2 for instance f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 on hv-cinder-82160 Jan 18 20:24:42.231491 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-f42cb405-fb7f-4973-993c-7dea9ec23b97 req-5e30692d-1eef-4da4-8740-7fdeffbd20a8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041403 Jan 18 20:24:42.232192 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 131/271] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:24:42.748274 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3020599d-585a-4b02-ad31-eb47873387fb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:42.749299 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3020599d-585a-4b02-ad31-eb47873387fb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:42.758155 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3020599d-585a-4b02-ad31-eb47873387fb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:42.758894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3020599d-585a-4b02-ad31-eb47873387fb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:42.760192 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3020599d-585a-4b02-ad31-eb47873387fb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:42.760930 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3020599d-585a-4b02-ad31-eb47873387fb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:42.789355 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-1c51b321-c310-4383-9c20-01bd8659906b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:42.791375 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-1c51b321-c310-4383-9c20-01bd8659906b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:42.803202 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1c51b321-c310-4383-9c20-01bd8659906b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:42.803966 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1c51b321-c310-4383-9c20-01bd8659906b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:42.805217 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1c51b321-c310-4383-9c20-01bd8659906b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:42.805756 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1c51b321-c310-4383-9c20-01bd8659906b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:45.289448 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3020599d-585a-4b02-ad31-eb47873387fb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28172 microversion: 2.1 time: 2.544936 Jan 18 20:24:45.290415 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 141/272] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:42 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28172 bytes in 2547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:45.298145 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d516a5b6-a5e4-4c87-8ac0-a8273d5b20b8 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:45.299010 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d516a5b6-a5e4-4c87-8ac0-a8273d5b20b8 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:45.308382 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d516a5b6-a5e4-4c87-8ac0-a8273d5b20b8 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:45.308821 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d516a5b6-a5e4-4c87-8ac0-a8273d5b20b8 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:45.309619 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d516a5b6-a5e4-4c87-8ac0-a8273d5b20b8 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:45.310049 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d516a5b6-a5e4-4c87-8ac0-a8273d5b20b8 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:45.318933 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-1c51b321-c310-4383-9c20-01bd8659906b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 28142 microversion: 2.20 time: 2.536968 Jan 18 20:24:45.320889 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 132/273] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:42 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 28142 bytes in 2541 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:24:45.331280 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-38389d59-b756-4ced-97dc-2d4b202c4d84 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:45.332803 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-38389d59-b756-4ced-97dc-2d4b202c4d84 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:45.360913 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-38389d59-b756-4ced-97dc-2d4b202c4d84 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:45.364574 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-38389d59-b756-4ced-97dc-2d4b202c4d84 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:45.366867 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-38389d59-b756-4ced-97dc-2d4b202c4d84 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:45.373423 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-38389d59-b756-4ced-97dc-2d4b202c4d84 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:45.547094 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d516a5b6-a5e4-4c87-8ac0-a8273d5b20b8 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:45.556362 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d516a5b6-a5e4-4c87-8ac0-a8273d5b20b8 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.263699 Jan 18 20:24:45.557065 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 142/274] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:45 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:45.618743 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-38389d59-b756-4ced-97dc-2d4b202c4d84 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:45.627754 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-38389d59-b756-4ced-97dc-2d4b202c4d84 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 200 len: 1317 microversion: 2.1 time: 0.303365 Jan 18 20:24:45.629550 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 133/275] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:45 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:46.303667 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9464515b-0a35-426d-8aed-cd36cc88d863 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:46.304808 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9464515b-0a35-426d-8aed-cd36cc88d863 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:46.311895 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9464515b-0a35-426d-8aed-cd36cc88d863 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:46.312351 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9464515b-0a35-426d-8aed-cd36cc88d863 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:46.313164 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9464515b-0a35-426d-8aed-cd36cc88d863 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:46.313613 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9464515b-0a35-426d-8aed-cd36cc88d863 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:46.335810 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-33062453-5090-4f6c-9e06-2870955e1663 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:46.337448 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-33062453-5090-4f6c-9e06-2870955e1663 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:46.348084 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-33062453-5090-4f6c-9e06-2870955e1663 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:46.348861 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-33062453-5090-4f6c-9e06-2870955e1663 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:46.350219 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-33062453-5090-4f6c-9e06-2870955e1663 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:46.351218 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-33062453-5090-4f6c-9e06-2870955e1663 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:49.011864 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9464515b-0a35-426d-8aed-cd36cc88d863 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28172 microversion: 2.1 time: 2.712115 Jan 18 20:24:49.012848 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 143/276] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:46 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28172 bytes in 2714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:49.017856 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3d9fa20a-7680-4d06-ac1a-aa7c97a88a13 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:49.018563 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3d9fa20a-7680-4d06-ac1a-aa7c97a88a13 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:49.025965 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3d9fa20a-7680-4d06-ac1a-aa7c97a88a13 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:49.026411 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3d9fa20a-7680-4d06-ac1a-aa7c97a88a13 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:49.027242 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3d9fa20a-7680-4d06-ac1a-aa7c97a88a13 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:49.027677 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3d9fa20a-7680-4d06-ac1a-aa7c97a88a13 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:49.077383 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-33062453-5090-4f6c-9e06-2870955e1663 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 28142 microversion: 2.20 time: 2.746862 Jan 18 20:24:49.078954 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 134/277] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:46 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 28142 bytes in 2749 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:24:49.086340 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d4a9139c-920d-440a-ad29-1a845937495c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:49.087204 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d4a9139c-920d-440a-ad29-1a845937495c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:49.097062 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d4a9139c-920d-440a-ad29-1a845937495c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:49.097861 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d4a9139c-920d-440a-ad29-1a845937495c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:49.099324 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d4a9139c-920d-440a-ad29-1a845937495c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:49.100078 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d4a9139c-920d-440a-ad29-1a845937495c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:49.194742 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3d9fa20a-7680-4d06-ac1a-aa7c97a88a13 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:49.204006 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3d9fa20a-7680-4d06-ac1a-aa7c97a88a13 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.189928 Jan 18 20:24:49.204592 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 144/278] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:49 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:49.283730 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d4a9139c-920d-440a-ad29-1a845937495c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:49.295365 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d4a9139c-920d-440a-ad29-1a845937495c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 200 len: 1317 microversion: 2.1 time: 0.214864 Jan 18 20:24:49.296233 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 135/279] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:49 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:50.028841 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ec713aa3-f260-464a-9002-a618b64d7eb9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:50.030553 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ec713aa3-f260-464a-9002-a618b64d7eb9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:50.042216 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ec713aa3-f260-464a-9002-a618b64d7eb9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:50.042977 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ec713aa3-f260-464a-9002-a618b64d7eb9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:50.044345 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ec713aa3-f260-464a-9002-a618b64d7eb9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:50.045067 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ec713aa3-f260-464a-9002-a618b64d7eb9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:50.092018 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e78fd152-bca0-437f-b945-8451ea874a83 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:50.092933 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e78fd152-bca0-437f-b945-8451ea874a83 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:50.101663 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e78fd152-bca0-437f-b945-8451ea874a83 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:50.102112 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e78fd152-bca0-437f-b945-8451ea874a83 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:50.103001 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e78fd152-bca0-437f-b945-8451ea874a83 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:50.103496 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e78fd152-bca0-437f-b945-8451ea874a83 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:50.170025 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ec713aa3-f260-464a-9002-a618b64d7eb9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28172 microversion: 2.1 time: 0.147471 Jan 18 20:24:50.172221 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 145/280] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:50 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28172 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:50.233768 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-286342f7-8b93-44bc-8a39-4e8b6ff84296 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:50.234828 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-286342f7-8b93-44bc-8a39-4e8b6ff84296 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:50.246393 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e78fd152-bca0-437f-b945-8451ea874a83 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 28142 microversion: 2.20 time: 0.158746 Jan 18 20:24:50.247649 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 136/281] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:50 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 28142 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:24:50.248887 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-286342f7-8b93-44bc-8a39-4e8b6ff84296 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:50.249646 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-286342f7-8b93-44bc-8a39-4e8b6ff84296 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:50.251053 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-286342f7-8b93-44bc-8a39-4e8b6ff84296 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:50.251786 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-286342f7-8b93-44bc-8a39-4e8b6ff84296 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:50.321502 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e7222da0-5d81-4c6e-be5e-30e5681feace tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:50.324693 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e7222da0-5d81-4c6e-be5e-30e5681feace tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:50.348423 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e7222da0-5d81-4c6e-be5e-30e5681feace tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:50.354632 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e7222da0-5d81-4c6e-be5e-30e5681feace tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:50.359425 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e7222da0-5d81-4c6e-be5e-30e5681feace tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:50.361591 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e7222da0-5d81-4c6e-be5e-30e5681feace tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:50.579249 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-286342f7-8b93-44bc-8a39-4e8b6ff84296 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:50.587600 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-286342f7-8b93-44bc-8a39-4e8b6ff84296 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.357963 Jan 18 20:24:50.598156 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 146/282] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:50 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:24:50.655492 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-e7222da0-5d81-4c6e-be5e-30e5681feace tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:50.678209 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e7222da0-5d81-4c6e-be5e-30e5681feace tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 200 len: 1507 microversion: 2.1 time: 0.363506 Jan 18 20:24:50.688610 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 137/283] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:50 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 1507 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:51.189245 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-32484ea0-0fc0-4686-8110-d98772b0b7f3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:51.190798 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-32484ea0-0fc0-4686-8110-d98772b0b7f3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:51.203945 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-32484ea0-0fc0-4686-8110-d98772b0b7f3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:51.206774 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-32484ea0-0fc0-4686-8110-d98772b0b7f3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:51.208418 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-32484ea0-0fc0-4686-8110-d98772b0b7f3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:51.209709 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-32484ea0-0fc0-4686-8110-d98772b0b7f3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:51.262730 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e264dd0b-91c0-4010-999a-6122d529751d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:51.265092 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e264dd0b-91c0-4010-999a-6122d529751d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:51.274669 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e264dd0b-91c0-4010-999a-6122d529751d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:51.275436 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e264dd0b-91c0-4010-999a-6122d529751d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:51.276513 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e264dd0b-91c0-4010-999a-6122d529751d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:51.277153 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e264dd0b-91c0-4010-999a-6122d529751d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:51.371135 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-32484ea0-0fc0-4686-8110-d98772b0b7f3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28172 microversion: 2.1 time: 0.185765 Jan 18 20:24:51.371589 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 147/284] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:51 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28172 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:24:51.400940 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e264dd0b-91c0-4010-999a-6122d529751d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 28142 microversion: 2.20 time: 0.137709 Jan 18 20:24:51.400940 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 138/285] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:51 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 28142 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:24:51.609608 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7ac347bc-6e5d-42ca-8639-6afc1241a036 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:51.610377 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7ac347bc-6e5d-42ca-8639-6afc1241a036 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:51.619463 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7ac347bc-6e5d-42ca-8639-6afc1241a036 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:51.619906 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7ac347bc-6e5d-42ca-8639-6afc1241a036 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:51.620764 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7ac347bc-6e5d-42ca-8639-6afc1241a036 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:51.621192 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7ac347bc-6e5d-42ca-8639-6afc1241a036 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:51.819093 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7ac347bc-6e5d-42ca-8639-6afc1241a036 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:51.826931 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7ac347bc-6e5d-42ca-8639-6afc1241a036 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1521 microversion: 2.1 time: 0.222702 Jan 18 20:24:51.828117 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 148/286] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:51 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:52.399008 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-724ad3e5-94b9-4a14-8224-853b5ef231f8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:52.401379 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-724ad3e5-94b9-4a14-8224-853b5ef231f8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:52.411374 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d29ffd60-dd01-4d32-b1dd-eb8ddc8bd795 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:52.413106 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d29ffd60-dd01-4d32-b1dd-eb8ddc8bd795 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:52.426338 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d29ffd60-dd01-4d32-b1dd-eb8ddc8bd795 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:52.428602 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d29ffd60-dd01-4d32-b1dd-eb8ddc8bd795 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:52.429389 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-724ad3e5-94b9-4a14-8224-853b5ef231f8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:52.432089 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d29ffd60-dd01-4d32-b1dd-eb8ddc8bd795 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:52.432328 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-724ad3e5-94b9-4a14-8224-853b5ef231f8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:52.433268 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-724ad3e5-94b9-4a14-8224-853b5ef231f8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:52.433823 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d29ffd60-dd01-4d32-b1dd-eb8ddc8bd795 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:52.436371 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-724ad3e5-94b9-4a14-8224-853b5ef231f8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:52.583117 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-724ad3e5-94b9-4a14-8224-853b5ef231f8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28172 microversion: 2.1 time: 0.201356 Jan 18 20:24:52.589615 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 139/287] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:52 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28172 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:52.589894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d29ffd60-dd01-4d32-b1dd-eb8ddc8bd795 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 28142 microversion: 2.20 time: 0.183128 Jan 18 20:24:52.591685 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 149/288] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:52 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 28142 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:24:52.591882 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-2e2aede3-f6d9-4923-8f53-7145e058d28f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5327a2b-23db-49f3-afd0-f9a4c78dc469"}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:52.592333 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-2e2aede3-f6d9-4923-8f53-7145e058d28f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:52.608469 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2e2aede3-f6d9-4923-8f53-7145e058d28f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:52.608921 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2e2aede3-f6d9-4923-8f53-7145e058d28f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:52.609722 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2e2aede3-f6d9-4923-8f53-7145e058d28f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:52.610153 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2e2aede3-f6d9-4923-8f53-7145e058d28f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:52.845809 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-79eae771-e22c-4f89-b306-cdcb9c23b17b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:52.847859 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-79eae771-e22c-4f89-b306-cdcb9c23b17b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:52.857035 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-79eae771-e22c-4f89-b306-cdcb9c23b17b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:52.858151 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-79eae771-e22c-4f89-b306-cdcb9c23b17b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:52.859583 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-79eae771-e22c-4f89-b306-cdcb9c23b17b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:52.861019 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-79eae771-e22c-4f89-b306-cdcb9c23b17b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:53.154184 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-79eae771-e22c-4f89-b306-cdcb9c23b17b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:53.164004 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-79eae771-e22c-4f89-b306-cdcb9c23b17b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1501 microversion: 2.1 time: 0.323097 Jan 18 20:24:53.164587 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 150/289] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:52 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1501 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:53.193177 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f374039a-0340-4c5d-8c0f-19d412938f35 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:53.194373 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f374039a-0340-4c5d-8c0f-19d412938f35 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:53.210043 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f374039a-0340-4c5d-8c0f-19d412938f35 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:53.210043 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f374039a-0340-4c5d-8c0f-19d412938f35 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:53.210043 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f374039a-0340-4c5d-8c0f-19d412938f35 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:53.210043 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f374039a-0340-4c5d-8c0f-19d412938f35 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:53.269953 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2e2aede3-f6d9-4923-8f53-7145e058d28f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "POST /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.684418 Jan 18 20:24:53.270637 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 140/290] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Jan 18 20:24:52 2022] POST /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00/os-volume_attachments => generated 194 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:24:53.458168 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f374039a-0340-4c5d-8c0f-19d412938f35 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:53.468535 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f374039a-0340-4c5d-8c0f-19d412938f35 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1515 microversion: 2.1 time: 0.281714 Jan 18 20:24:53.469182 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 151/291] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:53 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1515 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:53.603831 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5ac6815e-9e37-45e7-baea-8717cbe479d6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:53.606125 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6b8bc787-fdb9-46e2-a291-d062369cac46 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:53.607135 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-5ac6815e-9e37-45e7-baea-8717cbe479d6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:53.607826 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6b8bc787-fdb9-46e2-a291-d062369cac46 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:53.617160 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b8bc787-fdb9-46e2-a291-d062369cac46 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:53.617916 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b8bc787-fdb9-46e2-a291-d062369cac46 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:53.618903 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b8bc787-fdb9-46e2-a291-d062369cac46 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:53.619371 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b8bc787-fdb9-46e2-a291-d062369cac46 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:53.625776 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5ac6815e-9e37-45e7-baea-8717cbe479d6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:53.626992 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5ac6815e-9e37-45e7-baea-8717cbe479d6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:53.628838 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5ac6815e-9e37-45e7-baea-8717cbe479d6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:53.629752 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5ac6815e-9e37-45e7-baea-8717cbe479d6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:53.720932 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6b8bc787-fdb9-46e2-a291-d062369cac46 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 28142 microversion: 2.20 time: 0.118547 Jan 18 20:24:53.722945 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 152/292] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:53 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 28142 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:24:53.789734 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-5ac6815e-9e37-45e7-baea-8717cbe479d6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28462 microversion: 2.1 time: 0.193565 Jan 18 20:24:53.803187 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 141/293] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:53 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28462 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:54.742569 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6bf6c850-cccb-4170-bcfc-9fd53db55962 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:54.744731 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6bf6c850-cccb-4170-bcfc-9fd53db55962 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:54.764174 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6bf6c850-cccb-4170-bcfc-9fd53db55962 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:54.764955 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6bf6c850-cccb-4170-bcfc-9fd53db55962 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:54.767001 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6bf6c850-cccb-4170-bcfc-9fd53db55962 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:54.769064 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6bf6c850-cccb-4170-bcfc-9fd53db55962 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:54.813307 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b2bd9600-1112-4e5f-977d-ae6b18dfb0db tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:54.817034 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b2bd9600-1112-4e5f-977d-ae6b18dfb0db tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:54.825466 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b2bd9600-1112-4e5f-977d-ae6b18dfb0db tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:54.826330 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b2bd9600-1112-4e5f-977d-ae6b18dfb0db tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:54.827509 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b2bd9600-1112-4e5f-977d-ae6b18dfb0db tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:54.828199 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b2bd9600-1112-4e5f-977d-ae6b18dfb0db tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:54.914275 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6bf6c850-cccb-4170-bcfc-9fd53db55962 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 28174 microversion: 2.20 time: 0.179548 Jan 18 20:24:54.915710 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 153/294] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:54 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 28174 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:24:54.973774 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b2bd9600-1112-4e5f-977d-ae6b18dfb0db tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28462 microversion: 2.1 time: 0.172643 Jan 18 20:24:54.974913 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 142/295] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:54 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28462 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:24:55.109261 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8161b6e0-8e29-4f98-afb6-94246553f1a0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:55.110498 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8161b6e0-8e29-4f98-afb6-94246553f1a0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:55.119249 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8161b6e0-8e29-4f98-afb6-94246553f1a0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:55.119691 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8161b6e0-8e29-4f98-afb6-94246553f1a0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:55.120492 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8161b6e0-8e29-4f98-afb6-94246553f1a0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:55.120921 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8161b6e0-8e29-4f98-afb6-94246553f1a0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:55.160812 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-8161b6e0-8e29-4f98-afb6-94246553f1a0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lazy-loading 'flavor' on Instance uuid 712e0492-0709-4ab3-a1e2-5999b562d3fc {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:24:55.328168 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8161b6e0-8e29-4f98-afb6-94246553f1a0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "POST /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/action" status: 200 len: 32 microversion: 2.1 time: 0.222148 Jan 18 20:24:55.329643 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 154/296] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:55 2022] POST /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/action => generated 32 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 18 20:24:55.345100 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a7753e3e-2db1-49f6-b520-c8258ac88458 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:55.347143 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-a7753e3e-2db1-49f6-b520-c8258ac88458 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:55.378286 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a7753e3e-2db1-49f6-b520-c8258ac88458 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:55.379352 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a7753e3e-2db1-49f6-b520-c8258ac88458 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:55.381153 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a7753e3e-2db1-49f6-b520-c8258ac88458 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:55.382427 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a7753e3e-2db1-49f6-b520-c8258ac88458 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:55.907918 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a7753e3e-2db1-49f6-b520-c8258ac88458 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:55.935440 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a7753e3e-2db1-49f6-b520-c8258ac88458 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1521 microversion: 2.1 time: 0.596869 Jan 18 20:24:55.940521 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-37ae575a-ea3b-4b1e-a8e5-f2c71bbd84f0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:55.945052 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-37ae575a-ea3b-4b1e-a8e5-f2c71bbd84f0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:55.959595 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 143/297] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:55 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1521 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:55.961181 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-37ae575a-ea3b-4b1e-a8e5-f2c71bbd84f0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:55.962251 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-37ae575a-ea3b-4b1e-a8e5-f2c71bbd84f0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:55.964145 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-37ae575a-ea3b-4b1e-a8e5-f2c71bbd84f0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:55.965456 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-37ae575a-ea3b-4b1e-a8e5-f2c71bbd84f0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:55.993852 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4b3eeb76-3ffa-469a-b867-80c426425194 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:55.997348 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-4b3eeb76-3ffa-469a-b867-80c426425194 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:56.018559 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4b3eeb76-3ffa-469a-b867-80c426425194 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:56.019296 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4b3eeb76-3ffa-469a-b867-80c426425194 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:56.021253 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4b3eeb76-3ffa-469a-b867-80c426425194 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:56.022357 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4b3eeb76-3ffa-469a-b867-80c426425194 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:56.159904 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-4b3eeb76-3ffa-469a-b867-80c426425194 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28558 microversion: 2.1 time: 0.173182 Jan 18 20:24:56.160931 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 144/298] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:55 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:56.180022 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-37ae575a-ea3b-4b1e-a8e5-f2c71bbd84f0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 28431 microversion: 2.20 time: 0.252309 Jan 18 20:24:56.181002 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 155/299] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:55 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 28431 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:24:56.969263 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-cbca0a2b-5a48-4215-81b7-c5d2e9ef6cd7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:56.971217 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-cbca0a2b-5a48-4215-81b7-c5d2e9ef6cd7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:56.980189 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cbca0a2b-5a48-4215-81b7-c5d2e9ef6cd7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:56.980987 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cbca0a2b-5a48-4215-81b7-c5d2e9ef6cd7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:56.982041 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cbca0a2b-5a48-4215-81b7-c5d2e9ef6cd7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:56.982716 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cbca0a2b-5a48-4215-81b7-c5d2e9ef6cd7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:57.176077 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-20018eed-475e-44bd-ae31-6c2279ef8744 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:57.177930 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-20018eed-475e-44bd-ae31-6c2279ef8744 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:57.195907 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-20018eed-475e-44bd-ae31-6c2279ef8744 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:57.196909 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-20018eed-475e-44bd-ae31-6c2279ef8744 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:57.199915 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-20018eed-475e-44bd-ae31-6c2279ef8744 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:57.200773 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-20018eed-475e-44bd-ae31-6c2279ef8744 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:57.316513 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-20018eed-475e-44bd-ae31-6c2279ef8744 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28629 microversion: 2.1 time: 0.145592 Jan 18 20:24:57.318972 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 156/300] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:57 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28629 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:24:57.332182 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-68b8a4af-9a6f-4b38-afae-b0605b7130be tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:57.334083 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-68b8a4af-9a6f-4b38-afae-b0605b7130be tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:57.349725 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68b8a4af-9a6f-4b38-afae-b0605b7130be tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:57.350662 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68b8a4af-9a6f-4b38-afae-b0605b7130be tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:57.350878 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-cbca0a2b-5a48-4215-81b7-c5d2e9ef6cd7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:57.352159 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68b8a4af-9a6f-4b38-afae-b0605b7130be tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:57.353328 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68b8a4af-9a6f-4b38-afae-b0605b7130be tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:57.367647 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-cbca0a2b-5a48-4215-81b7-c5d2e9ef6cd7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1521 microversion: 2.1 time: 0.403779 Jan 18 20:24:57.369012 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 145/301] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:56 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:57.480759 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-68b8a4af-9a6f-4b38-afae-b0605b7130be tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 28589 microversion: 2.20 time: 0.158527 Jan 18 20:24:57.481921 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 157/302] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:57 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 28589 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:24:58.339956 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0ed3a332-3c06-4e33-8d19-6cde5e45e28c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:58.341734 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0ed3a332-3c06-4e33-8d19-6cde5e45e28c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:58.354389 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0ed3a332-3c06-4e33-8d19-6cde5e45e28c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:58.355377 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0ed3a332-3c06-4e33-8d19-6cde5e45e28c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:58.356696 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0ed3a332-3c06-4e33-8d19-6cde5e45e28c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:58.357588 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0ed3a332-3c06-4e33-8d19-6cde5e45e28c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:58.400481 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-98ea5620-b014-47ab-ae78-447f4ef555bc tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:58.401554 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-98ea5620-b014-47ab-ae78-447f4ef555bc tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:58.410375 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-98ea5620-b014-47ab-ae78-447f4ef555bc tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:58.410822 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-98ea5620-b014-47ab-ae78-447f4ef555bc tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:58.411663 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-98ea5620-b014-47ab-ae78-447f4ef555bc tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:58.412106 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-98ea5620-b014-47ab-ae78-447f4ef555bc tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:58.449996 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0ed3a332-3c06-4e33-8d19-6cde5e45e28c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28629 microversion: 2.1 time: 0.120151 Jan 18 20:24:58.452484 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 146/303] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:58 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28629 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:24:58.494990 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-941dd0bd-f118-4480-bbe0-a77cd567fb09 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:58.496102 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-941dd0bd-f118-4480-bbe0-a77cd567fb09 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:58.507629 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-941dd0bd-f118-4480-bbe0-a77cd567fb09 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:58.507629 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-941dd0bd-f118-4480-bbe0-a77cd567fb09 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:58.507629 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-941dd0bd-f118-4480-bbe0-a77cd567fb09 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:58.507629 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-941dd0bd-f118-4480-bbe0-a77cd567fb09 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:58.622281 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-941dd0bd-f118-4480-bbe0-a77cd567fb09 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 28591 microversion: 2.20 time: 0.131523 Jan 18 20:24:58.624896 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 147/304] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:58 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 28591 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:24:58.652988 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-98ea5620-b014-47ab-ae78-447f4ef555bc tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:24:58.662854 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-98ea5620-b014-47ab-ae78-447f4ef555bc tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1521 microversion: 2.1 time: 0.270660 Jan 18 20:24:58.663484 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 158/305] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:58 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:24:59.466326 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-84ec331d-30b3-4bee-bd5e-62b27f07f483 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:59.467436 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-84ec331d-30b3-4bee-bd5e-62b27f07f483 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:59.476471 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-84ec331d-30b3-4bee-bd5e-62b27f07f483 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:59.476918 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-84ec331d-30b3-4bee-bd5e-62b27f07f483 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:59.477724 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-84ec331d-30b3-4bee-bd5e-62b27f07f483 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:59.478162 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-84ec331d-30b3-4bee-bd5e-62b27f07f483 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:59.570898 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-84ec331d-30b3-4bee-bd5e-62b27f07f483 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28629 microversion: 2.1 time: 0.109277 Jan 18 20:24:59.571602 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 148/306] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:24:59 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28629 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:24:59.635760 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f5c27b80-7438-410f-9386-f2a4aecb291c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:24:59.636712 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f5c27b80-7438-410f-9386-f2a4aecb291c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:59.644116 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f5c27b80-7438-410f-9386-f2a4aecb291c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:59.644702 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f5c27b80-7438-410f-9386-f2a4aecb291c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:59.645502 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f5c27b80-7438-410f-9386-f2a4aecb291c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:59.645933 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f5c27b80-7438-410f-9386-f2a4aecb291c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:59.693457 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-1adbf32c-9d00-41e6-bb5b-7532f28e4859 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:24:59.694802 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-1adbf32c-9d00-41e6-bb5b-7532f28e4859 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:24:59.709303 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1adbf32c-9d00-41e6-bb5b-7532f28e4859 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:59.710876 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1adbf32c-9d00-41e6-bb5b-7532f28e4859 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:59.712591 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1adbf32c-9d00-41e6-bb5b-7532f28e4859 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:24:59.713451 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1adbf32c-9d00-41e6-bb5b-7532f28e4859 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:24:59.726000 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f5c27b80-7438-410f-9386-f2a4aecb291c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 28591 microversion: 2.20 time: 0.093300 Jan 18 20:24:59.727121 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 159/307] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:24:59 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 28591 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:25:00.032160 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-1adbf32c-9d00-41e6-bb5b-7532f28e4859 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:00.046508 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-1adbf32c-9d00-41e6-bb5b-7532f28e4859 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1521 microversion: 2.1 time: 0.360537 Jan 18 20:25:00.049231 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 149/308] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:24:59 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:00.585080 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-01e7d5a0-f61b-4a51-8c0a-0648b3c72c63 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:00.586509 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-01e7d5a0-f61b-4a51-8c0a-0648b3c72c63 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:00.595664 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-01e7d5a0-f61b-4a51-8c0a-0648b3c72c63 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:00.596399 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-01e7d5a0-f61b-4a51-8c0a-0648b3c72c63 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:00.597273 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-01e7d5a0-f61b-4a51-8c0a-0648b3c72c63 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:00.597834 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-01e7d5a0-f61b-4a51-8c0a-0648b3c72c63 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:00.715847 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-01e7d5a0-f61b-4a51-8c0a-0648b3c72c63 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28629 microversion: 2.1 time: 0.136200 Jan 18 20:25:00.716954 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 160/309] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:00 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28629 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:25:00.741078 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-8893f36e-deb8-4498-9b05-3bb318052d3d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:00.742739 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-8893f36e-deb8-4498-9b05-3bb318052d3d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:00.753312 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8893f36e-deb8-4498-9b05-3bb318052d3d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:00.753759 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8893f36e-deb8-4498-9b05-3bb318052d3d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:00.754547 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8893f36e-deb8-4498-9b05-3bb318052d3d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:00.754982 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8893f36e-deb8-4498-9b05-3bb318052d3d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:00.832870 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-8893f36e-deb8-4498-9b05-3bb318052d3d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 28591 microversion: 2.20 time: 0.097480 Jan 18 20:25:00.835285 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 150/310] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:00 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 28591 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:25:01.075455 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-eeccfa18-8777-4d03-81a2-5d3ffe2ac935 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:01.078143 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-eeccfa18-8777-4d03-81a2-5d3ffe2ac935 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:01.086692 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eeccfa18-8777-4d03-81a2-5d3ffe2ac935 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:01.087458 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eeccfa18-8777-4d03-81a2-5d3ffe2ac935 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:01.088791 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eeccfa18-8777-4d03-81a2-5d3ffe2ac935 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:01.089553 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eeccfa18-8777-4d03-81a2-5d3ffe2ac935 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:01.181284 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-6404c979-2424-41eb-a133-38c4e3058c1c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5327a2b-23db-49f3-afd0-f9a4c78dc469"}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:01.185820 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-6404c979-2424-41eb-a133-38c4e3058c1c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:01.206275 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6404c979-2424-41eb-a133-38c4e3058c1c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:01.207651 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6404c979-2424-41eb-a133-38c4e3058c1c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:01.209548 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6404c979-2424-41eb-a133-38c4e3058c1c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:01.211386 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6404c979-2424-41eb-a133-38c4e3058c1c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:01.393376 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-eeccfa18-8777-4d03-81a2-5d3ffe2ac935 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:01.405631 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-eeccfa18-8777-4d03-81a2-5d3ffe2ac935 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1521 microversion: 2.1 time: 0.334346 Jan 18 20:25:01.406485 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 161/311] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:01 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:01.440455 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-6404c979-2424-41eb-a133-38c4e3058c1c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] HTTP exception thrown: Invalid volume: volume f5327a2b-23db-49f3-afd0-f9a4c78dc469 is already attached to instances: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 Jan 18 20:25:01.442349 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-6404c979-2424-41eb-a133-38c4e3058c1c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Returning 400 to user: Invalid volume: volume f5327a2b-23db-49f3-afd0-f9a4c78dc469 is already attached to instances: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:25:01.443975 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-6404c979-2424-41eb-a133-38c4e3058c1c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "POST /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.272873 Jan 18 20:25:01.445102 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 151/312] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Jan 18 20:25:01 2022] POST /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00/os-volume_attachments => generated 174 bytes in 276 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 18 20:25:01.574690 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7717f3ad-350c-48bb-984b-721fe2594ad6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:01.575914 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7717f3ad-350c-48bb-984b-721fe2594ad6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:01.600379 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7717f3ad-350c-48bb-984b-721fe2594ad6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:01.601204 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7717f3ad-350c-48bb-984b-721fe2594ad6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:01.602681 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7717f3ad-350c-48bb-984b-721fe2594ad6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:01.603508 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7717f3ad-350c-48bb-984b-721fe2594ad6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:01.729252 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-081e5735-ca58-4f4a-8cd4-130423c14798 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:01.730705 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-081e5735-ca58-4f4a-8cd4-130423c14798 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:01.759182 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-081e5735-ca58-4f4a-8cd4-130423c14798 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:01.762880 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-081e5735-ca58-4f4a-8cd4-130423c14798 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:01.764158 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-081e5735-ca58-4f4a-8cd4-130423c14798 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:01.765496 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-081e5735-ca58-4f4a-8cd4-130423c14798 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:01.860367 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-081e5735-ca58-4f4a-8cd4-130423c14798 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28629 microversion: 2.1 time: 0.134840 Jan 18 20:25:01.868159 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 152/313] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:01 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28629 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:25:01.870207 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-20f22549-df75-45a5-9d8b-1eeda5015807 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:01.870574 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-20f22549-df75-45a5-9d8b-1eeda5015807 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:01.885106 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-20f22549-df75-45a5-9d8b-1eeda5015807 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:01.885579 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-20f22549-df75-45a5-9d8b-1eeda5015807 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:01.886628 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-20f22549-df75-45a5-9d8b-1eeda5015807 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:01.888211 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-20f22549-df75-45a5-9d8b-1eeda5015807 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:01.926105 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-7717f3ad-350c-48bb-984b-721fe2594ad6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lazy-loading 'services' on Instance uuid f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:25:02.004588 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-20f22549-df75-45a5-9d8b-1eeda5015807 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 28591 microversion: 2.20 time: 0.139871 Jan 18 20:25:02.005762 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 153/314] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:01 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 28591 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:25:02.193736 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7717f3ad-350c-48bb-984b-721fe2594ad6 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00/os-volume_attachments/f5327a2b-23db-49f3-afd0-f9a4c78dc469" status: 202 len: 0 microversion: 2.1 time: 0.629086 Jan 18 20:25:02.195890 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 162/315] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Jan 18 20:25:01 2022] DELETE /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00/os-volume_attachments/f5327a2b-23db-49f3-afd0-f9a4c78dc469 => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:25:02.216530 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-af3235a6-f85d-431b-a5a0-5837f8eba5f9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:02.218762 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-af3235a6-f85d-431b-a5a0-5837f8eba5f9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:02.244042 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-af3235a6-f85d-431b-a5a0-5837f8eba5f9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:02.246420 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-af3235a6-f85d-431b-a5a0-5837f8eba5f9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:02.249197 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-af3235a6-f85d-431b-a5a0-5837f8eba5f9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:02.250089 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-af3235a6-f85d-431b-a5a0-5837f8eba5f9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:02.296591 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-af3235a6-f85d-431b-a5a0-5837f8eba5f9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089615 Jan 18 20:25:02.297178 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 154/316] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:25:02 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:25:02.445770 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3ef1e6ce-ddd2-48a2-8bd2-901318519ed0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:02.447116 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3ef1e6ce-ddd2-48a2-8bd2-901318519ed0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:02.459730 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3ef1e6ce-ddd2-48a2-8bd2-901318519ed0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:02.460309 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3ef1e6ce-ddd2-48a2-8bd2-901318519ed0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:02.461290 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3ef1e6ce-ddd2-48a2-8bd2-901318519ed0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:02.461736 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3ef1e6ce-ddd2-48a2-8bd2-901318519ed0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:02.697585 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3ef1e6ce-ddd2-48a2-8bd2-901318519ed0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:02.712700 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3ef1e6ce-ddd2-48a2-8bd2-901318519ed0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1521 microversion: 2.1 time: 0.283381 Jan 18 20:25:02.725972 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 163/317] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:02 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:02.881419 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f2847167-4b36-476e-a206-7218debb68f4 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:02.885390 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-f2847167-4b36-476e-a206-7218debb68f4 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:02.902416 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f2847167-4b36-476e-a206-7218debb68f4 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:02.903659 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f2847167-4b36-476e-a206-7218debb68f4 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:02.905383 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f2847167-4b36-476e-a206-7218debb68f4 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:02.906512 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f2847167-4b36-476e-a206-7218debb68f4 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:03.020677 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-f2847167-4b36-476e-a206-7218debb68f4 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28629 microversion: 2.1 time: 0.147244 Jan 18 20:25:03.021682 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d175bbdf-f63d-443c-af0d-271b4ce44640 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:03.022134 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 155/318] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:02 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28629 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:25:03.023108 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d175bbdf-f63d-443c-af0d-271b4ce44640 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:03.034982 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d175bbdf-f63d-443c-af0d-271b4ce44640 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:03.036082 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d175bbdf-f63d-443c-af0d-271b4ce44640 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:03.038025 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d175bbdf-f63d-443c-af0d-271b4ce44640 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:03.039091 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d175bbdf-f63d-443c-af0d-271b4ce44640 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:03.128065 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d175bbdf-f63d-443c-af0d-271b4ce44640 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 28591 microversion: 2.20 time: 0.111836 Jan 18 20:25:03.128742 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 164/319] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:03 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 28591 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:25:03.320124 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-74e3ab97-9cba-4b08-bde9-30167834a866 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:03.322045 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-74e3ab97-9cba-4b08-bde9-30167834a866 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:03.361211 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-74e3ab97-9cba-4b08-bde9-30167834a866 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:03.362974 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-74e3ab97-9cba-4b08-bde9-30167834a866 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:03.367261 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-74e3ab97-9cba-4b08-bde9-30167834a866 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:03.368727 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-74e3ab97-9cba-4b08-bde9-30167834a866 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:03.431700 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-74e3ab97-9cba-4b08-bde9-30167834a866 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123734 Jan 18 20:25:03.433672 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 156/320] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:25:03 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:25:03.740709 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-52537e21-f8e3-4781-8af4-482e76237b82 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:03.741495 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-52537e21-f8e3-4781-8af4-482e76237b82 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:03.750507 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-52537e21-f8e3-4781-8af4-482e76237b82 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:03.750950 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-52537e21-f8e3-4781-8af4-482e76237b82 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:03.751803 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-52537e21-f8e3-4781-8af4-482e76237b82 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:03.752809 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-52537e21-f8e3-4781-8af4-482e76237b82 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:03.998104 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-52537e21-f8e3-4781-8af4-482e76237b82 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:04.015276 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-52537e21-f8e3-4781-8af4-482e76237b82 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1521 microversion: 2.1 time: 0.279030 Jan 18 20:25:04.031801 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 165/321] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:03 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:04.038544 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-6ab17f62-0988-4d68-8abe-b3d8c2ed0d5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:04.041278 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-6ab17f62-0988-4d68-8abe-b3d8c2ed0d5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:04.050503 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6ab17f62-0988-4d68-8abe-b3d8c2ed0d5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:04.051701 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6ab17f62-0988-4d68-8abe-b3d8c2ed0d5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:04.054270 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6ab17f62-0988-4d68-8abe-b3d8c2ed0d5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:04.055485 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6ab17f62-0988-4d68-8abe-b3d8c2ed0d5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:04.144432 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6b35dad6-fd19-4f94-97ce-bc500bd02f65 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:04.146040 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6b35dad6-fd19-4f94-97ce-bc500bd02f65 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:04.157619 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b35dad6-fd19-4f94-97ce-bc500bd02f65 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:04.158895 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b35dad6-fd19-4f94-97ce-bc500bd02f65 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:04.160244 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b35dad6-fd19-4f94-97ce-bc500bd02f65 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:04.160879 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b35dad6-fd19-4f94-97ce-bc500bd02f65 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:04.161911 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-6ab17f62-0988-4d68-8abe-b3d8c2ed0d5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28629 microversion: 2.1 time: 0.131838 Jan 18 20:25:04.163859 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 157/322] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:04 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28629 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:25:04.277414 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6b35dad6-fd19-4f94-97ce-bc500bd02f65 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 28591 microversion: 2.20 time: 0.139048 Jan 18 20:25:04.278693 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 166/323] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:04 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 28591 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:25:04.448239 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ad8e7f0a-19a4-429a-9da8-ba69428db8d0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:04.449648 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ad8e7f0a-19a4-429a-9da8-ba69428db8d0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:04.459327 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ad8e7f0a-19a4-429a-9da8-ba69428db8d0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:04.459778 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ad8e7f0a-19a4-429a-9da8-ba69428db8d0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:04.460632 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ad8e7f0a-19a4-429a-9da8-ba69428db8d0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:04.461112 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ad8e7f0a-19a4-429a-9da8-ba69428db8d0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:04.497523 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ad8e7f0a-19a4-429a-9da8-ba69428db8d0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054345 Jan 18 20:25:04.498405 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 158/324] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:25:04 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:25:04.708649 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a7ee7da3-4d50-4fd0-bc2c-13cbd0062c7a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1204422634", "imageRef": "c7d259ac-b206-430f-a3c0-794cee408236", "flavorRef": "452", "networks": [{"uuid": "dcb439eb-a130-48e2-8bcd-35ade9b8c9da"}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:04.798051 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-a7ee7da3-4d50-4fd0-bc2c-13cbd0062c7a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] validate_networks() for [('dcb439eb-a130-48e2-8bcd-35ade9b8c9da', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:25:05.044114 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0a87844d-efd5-42d4-9b89-b70ee0837b40 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:05.046151 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0a87844d-efd5-42d4-9b89-b70ee0837b40 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:05.059621 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0a87844d-efd5-42d4-9b89-b70ee0837b40 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:05.060745 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0a87844d-efd5-42d4-9b89-b70ee0837b40 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:05.062336 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0a87844d-efd5-42d4-9b89-b70ee0837b40 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:05.063374 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0a87844d-efd5-42d4-9b89-b70ee0837b40 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:05.305640 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-0a87844d-efd5-42d4-9b89-b70ee0837b40 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:05.322384 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0a87844d-efd5-42d4-9b89-b70ee0837b40 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1521 microversion: 2.1 time: 0.283299 Jan 18 20:25:05.323442 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 159/325] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:05 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:05.335144 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e7e5384d-c639-4c93-bab8-72ec4de5eba0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:05.335875 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e7e5384d-c639-4c93-bab8-72ec4de5eba0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:05.347214 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e7e5384d-c639-4c93-bab8-72ec4de5eba0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:05.348045 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e7e5384d-c639-4c93-bab8-72ec4de5eba0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:05.354099 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e7e5384d-c639-4c93-bab8-72ec4de5eba0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:05.354099 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e7e5384d-c639-4c93-bab8-72ec4de5eba0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:05.432434 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-a7ee7da3-4d50-4fd0-bc2c-13cbd0062c7a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:25:05.433185 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-a7ee7da3-4d50-4fd0-bc2c-13cbd0062c7a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:25:05.433849 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-a7ee7da3-4d50-4fd0-bc2c-13cbd0062c7a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:25:05.434566 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-a7ee7da3-4d50-4fd0-bc2c-13cbd0062c7a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:25:05.435411 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-a7ee7da3-4d50-4fd0-bc2c-13cbd0062c7a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:25:05.453134 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a7ee7da3-4d50-4fd0-bc2c-13cbd0062c7a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:05.453940 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a7ee7da3-4d50-4fd0-bc2c-13cbd0062c7a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:05.454346 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e7e5384d-c639-4c93-bab8-72ec4de5eba0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 28629 microversion: 2.1 time: 0.128374 Jan 18 20:25:05.455571 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 160/326] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:05 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 28629 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:25:05.455909 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a7ee7da3-4d50-4fd0-bc2c-13cbd0062c7a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:05.456811 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a7ee7da3-4d50-4fd0-bc2c-13cbd0062c7a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:05.466281 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-510a5248-160a-492c-83d6-c5ea3ab1347b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:05.468348 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-510a5248-160a-492c-83d6-c5ea3ab1347b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:05.482120 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-510a5248-160a-492c-83d6-c5ea3ab1347b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:05.483020 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-510a5248-160a-492c-83d6-c5ea3ab1347b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:05.484570 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-510a5248-160a-492c-83d6-c5ea3ab1347b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:05.485452 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-510a5248-160a-492c-83d6-c5ea3ab1347b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:05.489556 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-a7ee7da3-4d50-4fd0-bc2c-13cbd0062c7a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Getting quotas for project ac7d65640ff94651a7ef1d826ade4cfe. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:25:05.496657 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-a7ee7da3-4d50-4fd0-bc2c-13cbd0062c7a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Getting quotas for user 6c8a95c08cbe4253b4c279403eeb2bb6 and project ac7d65640ff94651a7ef1d826ade4cfe. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:25:05.515603 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a7ee7da3-4d50-4fd0-bc2c-13cbd0062c7a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:25:05.520352 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a7ee7da3-4d50-4fd0-bc2c-13cbd0062c7a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7d259ac-b206-430f-a3c0-794cee408236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:25:05.592211 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a7ee7da3-4d50-4fd0-bc2c-13cbd0062c7a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888264 Jan 18 20:25:05.597909 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 167/327] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:25:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 20:25:05.600339 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-510a5248-160a-492c-83d6-c5ea3ab1347b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 28591 microversion: 2.20 time: 0.141621 Jan 18 20:25:05.601753 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 161/328] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:05 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 28591 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:25:05.606413 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3516f0c7-39ca-4aa8-ba05-eaf558fdb993 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:05.606413 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3516f0c7-39ca-4aa8-ba05-eaf558fdb993 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:05.661436 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3516f0c7-39ca-4aa8-ba05-eaf558fdb993 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:05.672582 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3516f0c7-39ca-4aa8-ba05-eaf558fdb993 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1218 microversion: 2.1 time: 0.072575 Jan 18 20:25:05.673858 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 168/329] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:05 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:06.343781 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-2662ec55-804a-4c84-bd1c-fe283e99c841 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:06.345675 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-2662ec55-804a-4c84-bd1c-fe283e99c841 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:06.355437 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2662ec55-804a-4c84-bd1c-fe283e99c841 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:06.355908 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2662ec55-804a-4c84-bd1c-fe283e99c841 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:06.356739 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2662ec55-804a-4c84-bd1c-fe283e99c841 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:06.357302 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2662ec55-804a-4c84-bd1c-fe283e99c841 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:06.475621 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f4041ea4-9cf3-4cee-8eea-f5bb89e780a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:06.477454 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f4041ea4-9cf3-4cee-8eea-f5bb89e780a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:06.492152 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f4041ea4-9cf3-4cee-8eea-f5bb89e780a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:06.492863 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f4041ea4-9cf3-4cee-8eea-f5bb89e780a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:06.494603 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f4041ea4-9cf3-4cee-8eea-f5bb89e780a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:06.495888 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f4041ea4-9cf3-4cee-8eea-f5bb89e780a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:06.526974 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-2662ec55-804a-4c84-bd1c-fe283e99c841 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:06.538839 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2662ec55-804a-4c84-bd1c-fe283e99c841 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1521 microversion: 2.1 time: 0.200756 Jan 18 20:25:06.540091 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 162/330] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:06 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:06.617972 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-51328625-7310-4081-b0fb-f83a2d7d8490 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:06.619792 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-51328625-7310-4081-b0fb-f83a2d7d8490 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:06.624521 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f4041ea4-9cf3-4cee-8eea-f5bb89e780a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 29956 microversion: 2.1 time: 0.157325 Jan 18 20:25:06.625416 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 169/331] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:06 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 29956 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:25:06.630322 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-51328625-7310-4081-b0fb-f83a2d7d8490 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:06.630954 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-51328625-7310-4081-b0fb-f83a2d7d8490 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:06.631938 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-51328625-7310-4081-b0fb-f83a2d7d8490 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:06.632476 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-51328625-7310-4081-b0fb-f83a2d7d8490 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:06.694229 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1786ecce-a81d-40bf-ab3f-137d22bf2216 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:06.695187 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1786ecce-a81d-40bf-ab3f-137d22bf2216 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:06.702911 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1786ecce-a81d-40bf-ab3f-137d22bf2216 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:06.704076 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1786ecce-a81d-40bf-ab3f-137d22bf2216 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:06.704272 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1786ecce-a81d-40bf-ab3f-137d22bf2216 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:06.704694 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1786ecce-a81d-40bf-ab3f-137d22bf2216 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:06.766504 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-51328625-7310-4081-b0fb-f83a2d7d8490 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 29687 microversion: 2.20 time: 0.155643 Jan 18 20:25:06.768334 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 163/332] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:06 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 29687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:25:06.781137 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1786ecce-a81d-40bf-ab3f-137d22bf2216 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:06.789807 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1786ecce-a81d-40bf-ab3f-137d22bf2216 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1270 microversion: 2.1 time: 0.099484 Jan 18 20:25:06.790392 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 170/333] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:06 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:07.565774 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f8bd9727-d398-43f5-aee7-92bbc0a1d67b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:07.566483 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-f8bd9727-d398-43f5-aee7-92bbc0a1d67b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:07.573977 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f8bd9727-d398-43f5-aee7-92bbc0a1d67b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:07.574419 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f8bd9727-d398-43f5-aee7-92bbc0a1d67b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:07.575330 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f8bd9727-d398-43f5-aee7-92bbc0a1d67b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:07.575777 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f8bd9727-d398-43f5-aee7-92bbc0a1d67b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:07.639743 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-12427127-44c8-44a5-998c-2a67e7c9052e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:07.641517 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-12427127-44c8-44a5-998c-2a67e7c9052e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:07.653378 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-12427127-44c8-44a5-998c-2a67e7c9052e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:07.654706 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-12427127-44c8-44a5-998c-2a67e7c9052e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:07.657903 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-12427127-44c8-44a5-998c-2a67e7c9052e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:07.658852 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-12427127-44c8-44a5-998c-2a67e7c9052e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:07.765615 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-12427127-44c8-44a5-998c-2a67e7c9052e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 31095 microversion: 2.1 time: 0.131322 Jan 18 20:25:07.766288 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 171/334] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:07 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 31095 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:25:07.780733 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-68e598ad-c7cf-4dcd-bcb8-9ee2265a41ce tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:07.782396 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-68e598ad-c7cf-4dcd-bcb8-9ee2265a41ce tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:07.791403 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68e598ad-c7cf-4dcd-bcb8-9ee2265a41ce tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:07.791744 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68e598ad-c7cf-4dcd-bcb8-9ee2265a41ce tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:07.793065 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68e598ad-c7cf-4dcd-bcb8-9ee2265a41ce tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:07.793531 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68e598ad-c7cf-4dcd-bcb8-9ee2265a41ce tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:07.890958 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-68e598ad-c7cf-4dcd-bcb8-9ee2265a41ce tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 30830 microversion: 2.20 time: 0.113846 Jan 18 20:25:07.892699 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 172/335] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:07 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 30830 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:25:07.898097 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-f8bd9727-d398-43f5-aee7-92bbc0a1d67b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:07.901772 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d1d96784-87ad-438b-a1e8-9f694b13cfde tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:07.902374 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d1d96784-87ad-438b-a1e8-9f694b13cfde tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:07.912162 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d1d96784-87ad-438b-a1e8-9f694b13cfde tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:07.913018 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-f8bd9727-d398-43f5-aee7-92bbc0a1d67b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1521 microversion: 2.1 time: 0.351589 Jan 18 20:25:07.913790 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d1d96784-87ad-438b-a1e8-9f694b13cfde tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:07.914637 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 164/336] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:07 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:07.927082 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d1d96784-87ad-438b-a1e8-9f694b13cfde tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:07.927082 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d1d96784-87ad-438b-a1e8-9f694b13cfde tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:08.013236 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d1d96784-87ad-438b-a1e8-9f694b13cfde tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:08.030297 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d1d96784-87ad-438b-a1e8-9f694b13cfde tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1276 microversion: 2.1 time: 0.135499 Jan 18 20:25:08.031373 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 173/337] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:07 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:08.784317 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-078f0cb7-daa8-4561-a7ae-85ea6344348d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:08.786548 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-078f0cb7-daa8-4561-a7ae-85ea6344348d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:08.796628 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-078f0cb7-daa8-4561-a7ae-85ea6344348d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:08.798021 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-078f0cb7-daa8-4561-a7ae-85ea6344348d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:08.800069 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-078f0cb7-daa8-4561-a7ae-85ea6344348d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:08.800785 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-078f0cb7-daa8-4561-a7ae-85ea6344348d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:08.906788 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4a4b4a12-d723-49be-923e-9123470878ea tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:08.907927 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4a4b4a12-d723-49be-923e-9123470878ea tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:08.915706 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a4b4a12-d723-49be-923e-9123470878ea tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:08.915706 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a4b4a12-d723-49be-923e-9123470878ea tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:08.916424 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a4b4a12-d723-49be-923e-9123470878ea tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:08.916962 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a4b4a12-d723-49be-923e-9123470878ea tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:08.979176 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-078f0cb7-daa8-4561-a7ae-85ea6344348d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 32327 microversion: 2.1 time: 0.198607 Jan 18 20:25:08.979932 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 165/338] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:08 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 32327 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:25:08.986136 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-74abe8af-118e-498e-a5e6-d3f6ae222813 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:08.987567 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-74abe8af-118e-498e-a5e6-d3f6ae222813 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:08.995814 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-74abe8af-118e-498e-a5e6-d3f6ae222813 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:08.996256 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-74abe8af-118e-498e-a5e6-d3f6ae222813 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:08.997047 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-74abe8af-118e-498e-a5e6-d3f6ae222813 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:08.997476 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-74abe8af-118e-498e-a5e6-d3f6ae222813 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:09.053050 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4a4b4a12-d723-49be-923e-9123470878ea tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 31951 microversion: 2.20 time: 0.150344 Jan 18 20:25:09.054509 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 174/339] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:08 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 31951 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:25:09.066085 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6804f79f-74d3-4118-876f-cbe0fdb99b7b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:09.067228 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6804f79f-74d3-4118-876f-cbe0fdb99b7b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:09.074584 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6804f79f-74d3-4118-876f-cbe0fdb99b7b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:09.075302 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6804f79f-74d3-4118-876f-cbe0fdb99b7b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:09.076428 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6804f79f-74d3-4118-876f-cbe0fdb99b7b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:09.076863 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6804f79f-74d3-4118-876f-cbe0fdb99b7b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:09.252561 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6804f79f-74d3-4118-876f-cbe0fdb99b7b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:09.261613 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6804f79f-74d3-4118-876f-cbe0fdb99b7b tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1318 microversion: 2.1 time: 0.205173 Jan 18 20:25:09.262207 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 175/340] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:09 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:09.272762 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-74abe8af-118e-498e-a5e6-d3f6ae222813 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:09.288585 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-74abe8af-118e-498e-a5e6-d3f6ae222813 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1521 microversion: 2.1 time: 0.306967 Jan 18 20:25:09.289661 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 166/341] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:08 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:09.351494 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-da151ef8-e84a-4a72-a9c8-3304e782d6f6 req-bc7192ab-84a7-4866-a04d-384a1008b875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ea4f41-f0e8-4630-94ce-903130658ff4", "tag": "9574aa0a-7413-4cef-9d97-7a7b786add9a"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:09.353312 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:25:09.353312 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:25:09.362393 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-da151ef8-e84a-4a72-a9c8-3304e782d6f6 req-bc7192ab-84a7-4866-a04d-384a1008b875 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:09.362778 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-da151ef8-e84a-4a72-a9c8-3304e782d6f6 req-bc7192ab-84a7-4866-a04d-384a1008b875 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:09.380944 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-da151ef8-e84a-4a72-a9c8-3304e782d6f6 req-bc7192ab-84a7-4866-a04d-384a1008b875 service nova] Creating event network-changed:9574aa0a-7413-4cef-9d97-7a7b786add9a for instance 58ea4f41-f0e8-4630-94ce-903130658ff4 on hv-cinder-82160 Jan 18 20:25:09.390188 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-da151ef8-e84a-4a72-a9c8-3304e782d6f6 req-bc7192ab-84a7-4866-a04d-384a1008b875 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041839 Jan 18 20:25:09.391495 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 176/342] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:25:09.994268 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-10273367-baae-47ae-be19-1deaae7f924b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:09.995806 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-10273367-baae-47ae-be19-1deaae7f924b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:10.006141 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-10273367-baae-47ae-be19-1deaae7f924b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:10.006713 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-10273367-baae-47ae-be19-1deaae7f924b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:10.007794 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-10273367-baae-47ae-be19-1deaae7f924b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:10.008282 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-10273367-baae-47ae-be19-1deaae7f924b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:10.074651 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ecb74058-8a0c-4663-9025-7dc0c8662798 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:10.076118 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ecb74058-8a0c-4663-9025-7dc0c8662798 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:10.087967 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ecb74058-8a0c-4663-9025-7dc0c8662798 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:10.089438 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ecb74058-8a0c-4663-9025-7dc0c8662798 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:10.090477 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ecb74058-8a0c-4663-9025-7dc0c8662798 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:10.091550 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ecb74058-8a0c-4663-9025-7dc0c8662798 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:10.154003 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-10273367-baae-47ae-be19-1deaae7f924b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 32916 microversion: 2.1 time: 0.165021 Jan 18 20:25:10.160642 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 167/343] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:09 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 32916 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:25:10.224179 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ecb74058-8a0c-4663-9025-7dc0c8662798 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 32671 microversion: 2.20 time: 0.158041 Jan 18 20:25:10.224914 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 177/344] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:10 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 32671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:25:10.279727 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e8bbb61d-10da-473c-bc6d-e32c5edbabb7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:10.280440 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e8bbb61d-10da-473c-bc6d-e32c5edbabb7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:10.288002 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e8bbb61d-10da-473c-bc6d-e32c5edbabb7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:10.288445 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e8bbb61d-10da-473c-bc6d-e32c5edbabb7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:10.289339 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e8bbb61d-10da-473c-bc6d-e32c5edbabb7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:10.289701 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e8bbb61d-10da-473c-bc6d-e32c5edbabb7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:10.319867 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f4e11d87-5705-4a18-9631-271e3855124e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:10.321752 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f4e11d87-5705-4a18-9631-271e3855124e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:10.340102 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f4e11d87-5705-4a18-9631-271e3855124e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:10.341491 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f4e11d87-5705-4a18-9631-271e3855124e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:10.343078 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f4e11d87-5705-4a18-9631-271e3855124e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:10.344120 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f4e11d87-5705-4a18-9631-271e3855124e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:10.585191 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f4e11d87-5705-4a18-9631-271e3855124e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:10.600905 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f4e11d87-5705-4a18-9631-271e3855124e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1501 microversion: 2.1 time: 0.295021 Jan 18 20:25:10.602145 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 178/345] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:10 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1501 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:10.621935 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-e8bbb61d-10da-473c-bc6d-e32c5edbabb7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:10.630246 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a285c660-9d87-4cd0-bea1-6e66c616612f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b2c6e3f-6cee-4616-8984-be2800e64d5e"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:10.632846 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a285c660-9d87-4cd0-bea1-6e66c616612f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:10.643716 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e8bbb61d-10da-473c-bc6d-e32c5edbabb7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1318 microversion: 2.1 time: 0.367666 Jan 18 20:25:10.644794 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a285c660-9d87-4cd0-bea1-6e66c616612f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:10.645584 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a285c660-9d87-4cd0-bea1-6e66c616612f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:10.647579 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a285c660-9d87-4cd0-bea1-6e66c616612f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:10.648571 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a285c660-9d87-4cd0-bea1-6e66c616612f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:10.660438 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 168/346] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:10 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:10.691833 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-a285c660-9d87-4cd0-bea1-6e66c616612f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] HTTP exception thrown: Cannot 'attach_volume' instance 712e0492-0709-4ab3-a1e2-5999b562d3fc while it is in vm_state rescued Jan 18 20:25:10.692804 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a285c660-9d87-4cd0-bea1-6e66c616612f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Returning 409 to user: Cannot 'attach_volume' instance 712e0492-0709-4ab3-a1e2-5999b562d3fc while it is in vm_state rescued {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:25:10.694112 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a285c660-9d87-4cd0-bea1-6e66c616612f tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "POST /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.071060 Jan 18 20:25:10.694856 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 179/347] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Jan 18 20:25:10 2022] POST /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/os-volume_attachments => generated 152 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 18 20:25:10.709801 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-335f9e08-898f-4f97-b0de-4ef1bcfddf2b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:10.711085 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-335f9e08-898f-4f97-b0de-4ef1bcfddf2b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:10.724350 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-335f9e08-898f-4f97-b0de-4ef1bcfddf2b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:10.725350 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-335f9e08-898f-4f97-b0de-4ef1bcfddf2b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:10.726958 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-335f9e08-898f-4f97-b0de-4ef1bcfddf2b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:10.727890 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-335f9e08-898f-4f97-b0de-4ef1bcfddf2b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:10.872306 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-335f9e08-898f-4f97-b0de-4ef1bcfddf2b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "POST /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/action" status: 202 len: 0 microversion: 2.1 time: 0.169246 Jan 18 20:25:10.879331 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 169/348] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:10 2022] POST /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:25:10.891690 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3018774c-297c-4fbe-b525-5637580ee7a2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:10.893441 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3018774c-297c-4fbe-b525-5637580ee7a2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:10.907639 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3018774c-297c-4fbe-b525-5637580ee7a2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:10.908772 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3018774c-297c-4fbe-b525-5637580ee7a2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:10.909916 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3018774c-297c-4fbe-b525-5637580ee7a2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:10.910565 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3018774c-297c-4fbe-b525-5637580ee7a2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:11.168684 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3018774c-297c-4fbe-b525-5637580ee7a2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:11.170196 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b957d68b-13a3-4492-a5ff-ac0c0e05aae6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:11.171349 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b957d68b-13a3-4492-a5ff-ac0c0e05aae6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:11.180230 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b957d68b-13a3-4492-a5ff-ac0c0e05aae6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:11.180682 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b957d68b-13a3-4492-a5ff-ac0c0e05aae6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:11.182151 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b957d68b-13a3-4492-a5ff-ac0c0e05aae6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:11.182778 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b957d68b-13a3-4492-a5ff-ac0c0e05aae6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:11.186164 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3018774c-297c-4fbe-b525-5637580ee7a2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1509 microversion: 2.1 time: 0.304058 Jan 18 20:25:11.193284 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 180/349] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:10 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1509 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:11.238670 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-54f9daee-aaae-4667-a160-e2837b0a91cf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:11.239999 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-54f9daee-aaae-4667-a160-e2837b0a91cf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:11.246688 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-54f9daee-aaae-4667-a160-e2837b0a91cf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:11.247489 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-54f9daee-aaae-4667-a160-e2837b0a91cf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:11.248333 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-54f9daee-aaae-4667-a160-e2837b0a91cf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:11.248772 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-54f9daee-aaae-4667-a160-e2837b0a91cf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:11.286598 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b957d68b-13a3-4492-a5ff-ac0c0e05aae6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 33335 microversion: 2.1 time: 0.120135 Jan 18 20:25:11.287836 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 170/350] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:11 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 33335 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:25:11.352553 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-54f9daee-aaae-4667-a160-e2837b0a91cf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 33188 microversion: 2.20 time: 0.118481 Jan 18 20:25:11.353392 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 181/351] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:11 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 33188 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:25:11.673254 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b45f560c-0516-4435-9c15-6dd3f52d7373 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:11.674753 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b45f560c-0516-4435-9c15-6dd3f52d7373 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:11.682432 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b45f560c-0516-4435-9c15-6dd3f52d7373 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:11.683192 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b45f560c-0516-4435-9c15-6dd3f52d7373 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:11.684996 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b45f560c-0516-4435-9c15-6dd3f52d7373 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:11.686355 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b45f560c-0516-4435-9c15-6dd3f52d7373 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:11.883128 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b45f560c-0516-4435-9c15-6dd3f52d7373 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:11.891484 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b45f560c-0516-4435-9c15-6dd3f52d7373 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1318 microversion: 2.1 time: 0.222349 Jan 18 20:25:11.891975 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 171/352] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:11 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:12.217737 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-53a1ae9e-3bf9-43ae-ac64-f5d724af4d04 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:12.219254 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-53a1ae9e-3bf9-43ae-ac64-f5d724af4d04 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:12.228759 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-53a1ae9e-3bf9-43ae-ac64-f5d724af4d04 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:12.229260 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-53a1ae9e-3bf9-43ae-ac64-f5d724af4d04 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:12.230262 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-53a1ae9e-3bf9-43ae-ac64-f5d724af4d04 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:12.230683 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-53a1ae9e-3bf9-43ae-ac64-f5d724af4d04 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:12.298299 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-9c44aa9c-4065-4697-8b19-6c1c97e91997 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:12.300103 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-9c44aa9c-4065-4697-8b19-6c1c97e91997 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:12.307570 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9c44aa9c-4065-4697-8b19-6c1c97e91997 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:12.308070 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9c44aa9c-4065-4697-8b19-6c1c97e91997 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:12.308894 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9c44aa9c-4065-4697-8b19-6c1c97e91997 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:12.309388 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9c44aa9c-4065-4697-8b19-6c1c97e91997 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:12.401850 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-9c44aa9c-4065-4697-8b19-6c1c97e91997 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 33656 microversion: 2.1 time: 0.107040 Jan 18 20:25:12.402520 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 172/353] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:12 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 33656 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:25:12.408823 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d642adfe-cabe-4a47-bf4b-e775f8c1553b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:12.409698 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d642adfe-cabe-4a47-bf4b-e775f8c1553b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:12.414531 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-53a1ae9e-3bf9-43ae-ac64-f5d724af4d04 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:12.417580 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d642adfe-cabe-4a47-bf4b-e775f8c1553b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:12.418020 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d642adfe-cabe-4a47-bf4b-e775f8c1553b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:12.418807 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d642adfe-cabe-4a47-bf4b-e775f8c1553b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:12.419268 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d642adfe-cabe-4a47-bf4b-e775f8c1553b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:12.431366 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-53a1ae9e-3bf9-43ae-ac64-f5d724af4d04 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1509 microversion: 2.1 time: 0.220834 Jan 18 20:25:12.432552 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 182/354] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:12 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:12.522860 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d642adfe-cabe-4a47-bf4b-e775f8c1553b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 33581 microversion: 2.20 time: 0.118737 Jan 18 20:25:12.523495 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 173/355] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:12 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 33581 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:25:12.917353 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-04d07628-39a9-4762-80f5-d4df4f5432f1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:12.917927 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-04d07628-39a9-4762-80f5-d4df4f5432f1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:12.925622 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-04d07628-39a9-4762-80f5-d4df4f5432f1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:12.926149 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-04d07628-39a9-4762-80f5-d4df4f5432f1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:12.927210 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-04d07628-39a9-4762-80f5-d4df4f5432f1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:12.928024 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-04d07628-39a9-4762-80f5-d4df4f5432f1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:13.089755 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-04d07628-39a9-4762-80f5-d4df4f5432f1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:13.099127 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-04d07628-39a9-4762-80f5-d4df4f5432f1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1318 microversion: 2.1 time: 0.185531 Jan 18 20:25:13.099807 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 183/356] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:12 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:13.417594 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0e44de34-46b8-47fd-be72-c9334fc039fc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:13.418642 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0e44de34-46b8-47fd-be72-c9334fc039fc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:13.426993 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0e44de34-46b8-47fd-be72-c9334fc039fc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:13.427465 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0e44de34-46b8-47fd-be72-c9334fc039fc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:13.428279 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0e44de34-46b8-47fd-be72-c9334fc039fc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:13.428702 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0e44de34-46b8-47fd-be72-c9334fc039fc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:13.463187 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-14aff682-ae94-4d29-b151-a274ab930005 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:13.464230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-14aff682-ae94-4d29-b151-a274ab930005 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:13.474691 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-14aff682-ae94-4d29-b151-a274ab930005 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:13.475486 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-14aff682-ae94-4d29-b151-a274ab930005 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:13.476830 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-14aff682-ae94-4d29-b151-a274ab930005 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:13.477572 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-14aff682-ae94-4d29-b151-a274ab930005 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:13.537525 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0e44de34-46b8-47fd-be72-c9334fc039fc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 34076 microversion: 2.1 time: 0.124091 Jan 18 20:25:13.538483 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 174/357] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:13 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 34076 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:25:13.544301 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b0e0e263-6dd7-4de7-b927-77abeda0e650 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:13.545489 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b0e0e263-6dd7-4de7-b927-77abeda0e650 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:13.555269 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b0e0e263-6dd7-4de7-b927-77abeda0e650 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:13.556282 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b0e0e263-6dd7-4de7-b927-77abeda0e650 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:13.557646 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b0e0e263-6dd7-4de7-b927-77abeda0e650 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:13.558394 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b0e0e263-6dd7-4de7-b927-77abeda0e650 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:13.659244 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-14aff682-ae94-4d29-b151-a274ab930005 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:13.665724 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b0e0e263-6dd7-4de7-b927-77abeda0e650 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 34073 microversion: 2.20 time: 0.125527 Jan 18 20:25:13.671159 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 175/358] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:13 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 34073 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:25:13.671369 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-14aff682-ae94-4d29-b151-a274ab930005 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1509 microversion: 2.1 time: 0.213022 Jan 18 20:25:13.671369 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 184/359] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:13 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1509 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:14.119692 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-91a9b1fb-052d-4320-90e0-84bdec2227f4 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:14.120576 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-91a9b1fb-052d-4320-90e0-84bdec2227f4 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:14.129602 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-91a9b1fb-052d-4320-90e0-84bdec2227f4 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:14.130089 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-91a9b1fb-052d-4320-90e0-84bdec2227f4 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:14.130849 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-91a9b1fb-052d-4320-90e0-84bdec2227f4 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:14.131325 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-91a9b1fb-052d-4320-90e0-84bdec2227f4 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:14.360671 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-91a9b1fb-052d-4320-90e0-84bdec2227f4 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:14.369364 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-91a9b1fb-052d-4320-90e0-84bdec2227f4 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1318 microversion: 2.1 time: 0.254778 Jan 18 20:25:14.369968 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 176/360] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:14 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:14.553857 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-32872659-05c8-4ff8-bb4b-67281251302b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:14.555008 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-32872659-05c8-4ff8-bb4b-67281251302b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:14.563341 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-32872659-05c8-4ff8-bb4b-67281251302b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:14.564055 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-32872659-05c8-4ff8-bb4b-67281251302b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:14.565623 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-32872659-05c8-4ff8-bb4b-67281251302b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:14.566091 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-32872659-05c8-4ff8-bb4b-67281251302b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:14.664519 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-32872659-05c8-4ff8-bb4b-67281251302b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 34660 microversion: 2.1 time: 0.115370 Jan 18 20:25:14.665263 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 185/361] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:14 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 34660 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:25:14.680510 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-2e3d29d4-861f-4c81-8d58-b8cf412bb013 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:14.681453 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-2e3d29d4-861f-4c81-8d58-b8cf412bb013 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:14.688497 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2e3d29d4-861f-4c81-8d58-b8cf412bb013 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:14.689003 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2e3d29d4-861f-4c81-8d58-b8cf412bb013 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:14.690401 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2e3d29d4-861f-4c81-8d58-b8cf412bb013 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:14.690888 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2e3d29d4-861f-4c81-8d58-b8cf412bb013 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:14.693153 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-12ef3e7d-2dd2-4d1a-8f8c-4ad24861ed1a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:14.694356 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-12ef3e7d-2dd2-4d1a-8f8c-4ad24861ed1a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:14.705584 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-12ef3e7d-2dd2-4d1a-8f8c-4ad24861ed1a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:14.706119 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-12ef3e7d-2dd2-4d1a-8f8c-4ad24861ed1a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:14.707556 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-12ef3e7d-2dd2-4d1a-8f8c-4ad24861ed1a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:14.708265 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-12ef3e7d-2dd2-4d1a-8f8c-4ad24861ed1a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:14.794550 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2e3d29d4-861f-4c81-8d58-b8cf412bb013 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 34613 microversion: 2.20 time: 0.117397 Jan 18 20:25:14.799738 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 177/362] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:14 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 34613 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:25:14.888150 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-12ef3e7d-2dd2-4d1a-8f8c-4ad24861ed1a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:14.896984 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-12ef3e7d-2dd2-4d1a-8f8c-4ad24861ed1a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1515 microversion: 2.1 time: 0.210663 Jan 18 20:25:14.897585 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 186/363] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:14 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1515 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:15.390963 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0fc53fd2-e436-4623-84bc-9b5dc5d515ad tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:15.391771 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0fc53fd2-e436-4623-84bc-9b5dc5d515ad tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:15.400311 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0fc53fd2-e436-4623-84bc-9b5dc5d515ad tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:15.400870 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0fc53fd2-e436-4623-84bc-9b5dc5d515ad tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:15.401730 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0fc53fd2-e436-4623-84bc-9b5dc5d515ad tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:15.402201 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0fc53fd2-e436-4623-84bc-9b5dc5d515ad tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:15.583980 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-0fc53fd2-e436-4623-84bc-9b5dc5d515ad tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:15.591706 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0fc53fd2-e436-4623-84bc-9b5dc5d515ad tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1318 microversion: 2.1 time: 0.205443 Jan 18 20:25:15.592314 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 178/364] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:15 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:15.678696 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-373b9b93-ecba-459e-9a8a-e9294d1a6743 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:15.679822 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-373b9b93-ecba-459e-9a8a-e9294d1a6743 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:15.687864 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-373b9b93-ecba-459e-9a8a-e9294d1a6743 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:15.688301 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-373b9b93-ecba-459e-9a8a-e9294d1a6743 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:15.689273 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-373b9b93-ecba-459e-9a8a-e9294d1a6743 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:15.690288 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-373b9b93-ecba-459e-9a8a-e9294d1a6743 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:15.792604 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-373b9b93-ecba-459e-9a8a-e9294d1a6743 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 35209 microversion: 2.1 time: 0.119093 Jan 18 20:25:15.793264 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 187/365] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:15 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 35209 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:25:15.808684 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-c0ffd479-16c9-46c8-8925-bb7bbf13ab20 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:15.809627 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-c0ffd479-16c9-46c8-8925-bb7bbf13ab20 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:15.817278 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c0ffd479-16c9-46c8-8925-bb7bbf13ab20 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:15.817727 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c0ffd479-16c9-46c8-8925-bb7bbf13ab20 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:15.818529 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c0ffd479-16c9-46c8-8925-bb7bbf13ab20 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:15.818962 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c0ffd479-16c9-46c8-8925-bb7bbf13ab20 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:15.938930 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-c0ffd479-16c9-46c8-8925-bb7bbf13ab20 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 35249 microversion: 2.20 time: 0.133587 Jan 18 20:25:15.940194 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 179/366] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:15 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 35249 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:25:16.378955 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2a3dfd03-a909-4250-9b36-8e55df299d78 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:16.379699 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2a3dfd03-a909-4250-9b36-8e55df299d78 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:16.387431 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2a3dfd03-a909-4250-9b36-8e55df299d78 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:16.387976 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2a3dfd03-a909-4250-9b36-8e55df299d78 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:16.389049 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2a3dfd03-a909-4250-9b36-8e55df299d78 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:16.389592 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2a3dfd03-a909-4250-9b36-8e55df299d78 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:16.565999 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2a3dfd03-a909-4250-9b36-8e55df299d78 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:16.574222 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2a3dfd03-a909-4250-9b36-8e55df299d78 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1515 microversion: 2.1 time: 0.199909 Jan 18 20:25:16.574735 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 188/367] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:16 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:16.591855 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-586ce79b-b6aa-4a28-a036-eb4f34ef8b8b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "616acd30-dfe5-4fde-92fc-3653f24dff86"}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:16.593017 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-586ce79b-b6aa-4a28-a036-eb4f34ef8b8b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:16.600686 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-586ce79b-b6aa-4a28-a036-eb4f34ef8b8b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:16.601145 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-586ce79b-b6aa-4a28-a036-eb4f34ef8b8b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:16.601972 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-586ce79b-b6aa-4a28-a036-eb4f34ef8b8b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:16.602407 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-586ce79b-b6aa-4a28-a036-eb4f34ef8b8b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:16.610650 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b505610e-63b0-4217-8224-c770c25e88c5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:16.611998 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b505610e-63b0-4217-8224-c770c25e88c5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:16.623195 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b505610e-63b0-4217-8224-c770c25e88c5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:16.623969 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b505610e-63b0-4217-8224-c770c25e88c5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:16.625518 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b505610e-63b0-4217-8224-c770c25e88c5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:16.626272 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b505610e-63b0-4217-8224-c770c25e88c5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:16.869459 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b505610e-63b0-4217-8224-c770c25e88c5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:16.889550 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b505610e-63b0-4217-8224-c770c25e88c5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1318 microversion: 2.1 time: 0.283121 Jan 18 20:25:16.890239 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 189/368] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:16 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:16.896970 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-46d1ed10-d7c6-4684-93d9-288aa1f0ccf3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:16.898572 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-46d1ed10-d7c6-4684-93d9-288aa1f0ccf3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:16.911753 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-46d1ed10-d7c6-4684-93d9-288aa1f0ccf3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:16.911971 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-46d1ed10-d7c6-4684-93d9-288aa1f0ccf3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:16.912718 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-46d1ed10-d7c6-4684-93d9-288aa1f0ccf3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:16.914368 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-46d1ed10-d7c6-4684-93d9-288aa1f0ccf3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:16.973071 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-586ce79b-b6aa-4a28-a036-eb4f34ef8b8b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "POST /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385416 Jan 18 20:25:16.974158 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 180/369] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Jan 18 20:25:16 2022] POST /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:25:16.984771 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a8d98ded-58a7-43dc-91ec-f7601e5419b9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:16.987279 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-a8d98ded-58a7-43dc-91ec-f7601e5419b9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:16.998448 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a8d98ded-58a7-43dc-91ec-f7601e5419b9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:16.999350 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a8d98ded-58a7-43dc-91ec-f7601e5419b9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:17.000833 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a8d98ded-58a7-43dc-91ec-f7601e5419b9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:17.001983 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a8d98ded-58a7-43dc-91ec-f7601e5419b9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:17.096087 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-46d1ed10-d7c6-4684-93d9-288aa1f0ccf3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 36058 microversion: 2.1 time: 0.203347 Jan 18 20:25:17.097068 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 190/370] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:16 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 36058 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:25:17.120572 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a8d98ded-58a7-43dc-91ec-f7601e5419b9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 35898 microversion: 2.20 time: 0.143347 Jan 18 20:25:17.121844 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 181/371] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:16 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 35898 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:25:17.911984 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fabbfba5-814b-47fa-be31-a91dd95c226d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:17.913207 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fabbfba5-814b-47fa-be31-a91dd95c226d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:17.925634 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fabbfba5-814b-47fa-be31-a91dd95c226d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:17.926439 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fabbfba5-814b-47fa-be31-a91dd95c226d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:17.928002 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fabbfba5-814b-47fa-be31-a91dd95c226d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:17.928773 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fabbfba5-814b-47fa-be31-a91dd95c226d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:18.118240 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-47b862d0-c045-4849-bc45-c2b6ffe18450 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:18.119865 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-47b862d0-c045-4849-bc45-c2b6ffe18450 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:18.133207 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-47b862d0-c045-4849-bc45-c2b6ffe18450 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:18.133364 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-47b862d0-c045-4849-bc45-c2b6ffe18450 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:18.134544 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-47b862d0-c045-4849-bc45-c2b6ffe18450 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:18.135274 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-47b862d0-c045-4849-bc45-c2b6ffe18450 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:18.194138 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fabbfba5-814b-47fa-be31-a91dd95c226d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:18.204205 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fabbfba5-814b-47fa-be31-a91dd95c226d tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1318 microversion: 2.1 time: 0.300286 Jan 18 20:25:18.205340 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 191/372] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:17 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:18.210578 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-781bdbf1-5cb7-48ed-91b9-d0ee7a64e13e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:18.211781 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-781bdbf1-5cb7-48ed-91b9-d0ee7a64e13e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:18.220271 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-781bdbf1-5cb7-48ed-91b9-d0ee7a64e13e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:18.221793 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-781bdbf1-5cb7-48ed-91b9-d0ee7a64e13e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:18.223628 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-781bdbf1-5cb7-48ed-91b9-d0ee7a64e13e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:18.224580 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-781bdbf1-5cb7-48ed-91b9-d0ee7a64e13e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:18.255777 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-47b862d0-c045-4849-bc45-c2b6ffe18450 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 36810 microversion: 2.1 time: 0.144519 Jan 18 20:25:18.260985 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 182/373] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:18 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 36810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:25:18.342183 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-781bdbf1-5cb7-48ed-91b9-d0ee7a64e13e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 36781 microversion: 2.20 time: 0.135512 Jan 18 20:25:18.343061 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 192/374] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:18 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 36781 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:25:18.434604 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-fac79f14-90b0-47e4-af61-232d6b00e693 req-6b6de124-548a-4f84-a77e-3e8639037594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ea4f41-f0e8-4630-94ce-903130658ff4", "name": "network-vif-plugged", "status": "completed", "tag": "9574aa0a-7413-4cef-9d97-7a7b786add9a"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:18.436373 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:25:18.436373 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:25:18.449979 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-fac79f14-90b0-47e4-af61-232d6b00e693 req-6b6de124-548a-4f84-a77e-3e8639037594 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:18.450782 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-fac79f14-90b0-47e4-af61-232d6b00e693 req-6b6de124-548a-4f84-a77e-3e8639037594 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:18.477140 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-fac79f14-90b0-47e4-af61-232d6b00e693 req-6b6de124-548a-4f84-a77e-3e8639037594 service nova] Creating event network-vif-plugged:9574aa0a-7413-4cef-9d97-7a7b786add9a for instance 58ea4f41-f0e8-4630-94ce-903130658ff4 on hv-cinder-82160 Jan 18 20:25:18.488770 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-fac79f14-90b0-47e4-af61-232d6b00e693 req-6b6de124-548a-4f84-a77e-3e8639037594 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057979 Jan 18 20:25:18.490170 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 183/375] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:25:19.230053 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fc56f64f-d7b2-4b73-acc2-1f493bc89d14 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:19.230755 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fc56f64f-d7b2-4b73-acc2-1f493bc89d14 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:19.238826 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fc56f64f-d7b2-4b73-acc2-1f493bc89d14 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:19.239300 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fc56f64f-d7b2-4b73-acc2-1f493bc89d14 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:19.240113 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fc56f64f-d7b2-4b73-acc2-1f493bc89d14 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:19.240550 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fc56f64f-d7b2-4b73-acc2-1f493bc89d14 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:19.272119 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-23781abb-d5c6-48eb-9f34-ff5ea75a0054 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:19.273147 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-23781abb-d5c6-48eb-9f34-ff5ea75a0054 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:19.280437 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-23781abb-d5c6-48eb-9f34-ff5ea75a0054 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:19.280885 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-23781abb-d5c6-48eb-9f34-ff5ea75a0054 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:19.281695 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-23781abb-d5c6-48eb-9f34-ff5ea75a0054 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:19.282204 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-23781abb-d5c6-48eb-9f34-ff5ea75a0054 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:19.391847 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-23781abb-d5c6-48eb-9f34-ff5ea75a0054 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 37629 microversion: 2.1 time: 0.123322 Jan 18 20:25:19.393405 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 184/376] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:19 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 37629 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:25:19.401673 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-c2f95655-dbf1-4b92-a64d-17ab8f2cd172 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:19.402872 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-c2f95655-dbf1-4b92-a64d-17ab8f2cd172 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:19.411485 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c2f95655-dbf1-4b92-a64d-17ab8f2cd172 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:19.412007 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c2f95655-dbf1-4b92-a64d-17ab8f2cd172 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:19.412793 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c2f95655-dbf1-4b92-a64d-17ab8f2cd172 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:19.413214 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c2f95655-dbf1-4b92-a64d-17ab8f2cd172 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:19.416879 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fc56f64f-d7b2-4b73-acc2-1f493bc89d14 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:19.428585 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fc56f64f-d7b2-4b73-acc2-1f493bc89d14 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1318 microversion: 2.1 time: 0.202220 Jan 18 20:25:19.429457 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 193/377] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:19 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:19.528532 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-c2f95655-dbf1-4b92-a64d-17ab8f2cd172 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 37619 microversion: 2.20 time: 0.132990 Jan 18 20:25:19.529226 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 185/378] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:19 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 37619 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:25:20.413762 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-00e3fe45-35f7-44a9-9586-d68dd623f009 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:20.416653 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-00e3fe45-35f7-44a9-9586-d68dd623f009 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:20.428555 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-00e3fe45-35f7-44a9-9586-d68dd623f009 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:20.429343 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-00e3fe45-35f7-44a9-9586-d68dd623f009 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:20.430627 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-00e3fe45-35f7-44a9-9586-d68dd623f009 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:20.433869 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-00e3fe45-35f7-44a9-9586-d68dd623f009 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:20.454547 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a29cabe8-567e-4ae5-af22-3423bbe33db5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:20.457229 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-a29cabe8-567e-4ae5-af22-3423bbe33db5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:20.469925 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a29cabe8-567e-4ae5-af22-3423bbe33db5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:20.470676 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a29cabe8-567e-4ae5-af22-3423bbe33db5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:20.472312 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a29cabe8-567e-4ae5-af22-3423bbe33db5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:20.472901 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a29cabe8-567e-4ae5-af22-3423bbe33db5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:20.585572 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-00e3fe45-35f7-44a9-9586-d68dd623f009 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 38102 microversion: 2.1 time: 0.182033 Jan 18 20:25:20.587608 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 194/379] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:20 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 38102 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:25:20.606430 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8e35b425-a629-4f49-b246-6222686e0e2b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:20.608514 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8e35b425-a629-4f49-b246-6222686e0e2b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:20.622024 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8e35b425-a629-4f49-b246-6222686e0e2b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:20.622984 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8e35b425-a629-4f49-b246-6222686e0e2b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:20.624858 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8e35b425-a629-4f49-b246-6222686e0e2b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:20.625936 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8e35b425-a629-4f49-b246-6222686e0e2b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:20.653284 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a29cabe8-567e-4ae5-af22-3423bbe33db5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:20.662963 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a29cabe8-567e-4ae5-af22-3423bbe33db5 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1507 microversion: 2.1 time: 0.213595 Jan 18 20:25:20.663918 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 186/380] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:20 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1507 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:20.742432 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8e35b425-a629-4f49-b246-6222686e0e2b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 38101 microversion: 2.20 time: 0.144274 Jan 18 20:25:20.743217 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 195/381] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:20 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 38101 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:25:21.600686 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ce034e9b-4ca6-460f-a9fc-0285323b0fa5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:21.601742 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ce034e9b-4ca6-460f-a9fc-0285323b0fa5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:21.609187 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ce034e9b-4ca6-460f-a9fc-0285323b0fa5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:21.609684 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ce034e9b-4ca6-460f-a9fc-0285323b0fa5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:21.610524 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ce034e9b-4ca6-460f-a9fc-0285323b0fa5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:21.611731 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ce034e9b-4ca6-460f-a9fc-0285323b0fa5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:21.723821 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ce034e9b-4ca6-460f-a9fc-0285323b0fa5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 38114 microversion: 2.1 time: 0.126508 Jan 18 20:25:21.724998 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 187/382] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:21 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 38114 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:25:21.756578 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-29095c38-ae2e-4639-8537-a3ffa4a404ee tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:21.757619 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-29095c38-ae2e-4639-8537-a3ffa4a404ee tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:21.765144 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-29095c38-ae2e-4639-8537-a3ffa4a404ee tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:21.765594 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-29095c38-ae2e-4639-8537-a3ffa4a404ee tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:21.766404 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-29095c38-ae2e-4639-8537-a3ffa4a404ee tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:21.766844 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-29095c38-ae2e-4639-8537-a3ffa4a404ee tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:21.862149 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-29095c38-ae2e-4639-8537-a3ffa4a404ee tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 38101 microversion: 2.20 time: 0.109408 Jan 18 20:25:21.862963 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 196/383] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:21 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 38101 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:25:22.156243 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d6c3c670-d91a-4477-868f-6012e38dac4a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a807034-e939-4361-ab87-040224645b0e"}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:22.158167 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d6c3c670-d91a-4477-868f-6012e38dac4a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:22.167254 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d6c3c670-d91a-4477-868f-6012e38dac4a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:22.167721 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d6c3c670-d91a-4477-868f-6012e38dac4a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:22.168710 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d6c3c670-d91a-4477-868f-6012e38dac4a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:22.169209 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d6c3c670-d91a-4477-868f-6012e38dac4a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:22.496674 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d6c3c670-d91a-4477-868f-6012e38dac4a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "POST /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347011 Jan 18 20:25:22.498871 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 188/384] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Jan 18 20:25:22 2022] POST /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:25:22.738499 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3fdb1b7b-3bdf-4cbd-94aa-06477769b794 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:22.739527 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3fdb1b7b-3bdf-4cbd-94aa-06477769b794 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:22.747759 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3fdb1b7b-3bdf-4cbd-94aa-06477769b794 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:22.748182 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3fdb1b7b-3bdf-4cbd-94aa-06477769b794 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:22.749003 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3fdb1b7b-3bdf-4cbd-94aa-06477769b794 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:22.749439 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3fdb1b7b-3bdf-4cbd-94aa-06477769b794 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:22.870848 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3fdb1b7b-3bdf-4cbd-94aa-06477769b794 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 200 len: 38231 microversion: 2.1 time: 0.136745 Jan 18 20:25:22.871852 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 197/385] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:22 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 38231 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:25:22.877129 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-01a18269-4e2f-4b31-80c8-ae158fd5396b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:22.879725 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-01a18269-4e2f-4b31-80c8-ae158fd5396b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:22.885282 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a63fea8e-72be-48c1-beb5-995944d05257 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:22.885886 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a63fea8e-72be-48c1-beb5-995944d05257 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:22.888910 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-01a18269-4e2f-4b31-80c8-ae158fd5396b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:22.889639 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-01a18269-4e2f-4b31-80c8-ae158fd5396b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:22.890650 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-01a18269-4e2f-4b31-80c8-ae158fd5396b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:22.891504 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-01a18269-4e2f-4b31-80c8-ae158fd5396b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:22.894002 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a63fea8e-72be-48c1-beb5-995944d05257 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:22.894493 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a63fea8e-72be-48c1-beb5-995944d05257 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:22.895431 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a63fea8e-72be-48c1-beb5-995944d05257 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:22.895874 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a63fea8e-72be-48c1-beb5-995944d05257 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:22.929087 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a63fea8e-72be-48c1-beb5-995944d05257 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/ips" status: 200 len: 145 microversion: 2.1 time: 0.049138 Jan 18 20:25:22.930760 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 198/386] 10.222.0.67 () {58 vars in 1247 bytes} [Tue Jan 18 20:25:22 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/ips => generated 145 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:25:23.019755 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-01a18269-4e2f-4b31-80c8-ae158fd5396b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 200 len: 38242 microversion: 2.20 time: 0.148855 Jan 18 20:25:23.020333 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 189/387] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:22 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 38242 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:25:23.038308 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b0b0f87a-9dec-456e-a350-c0dc3e63d087 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:23.039113 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b0b0f87a-9dec-456e-a350-c0dc3e63d087 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:23.052711 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0b0f87a-9dec-456e-a350-c0dc3e63d087 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:23.053504 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0b0f87a-9dec-456e-a350-c0dc3e63d087 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:23.055316 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0b0f87a-9dec-456e-a350-c0dc3e63d087 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:23.056161 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0b0f87a-9dec-456e-a350-c0dc3e63d087 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:23.085735 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b0b0f87a-9dec-456e-a350-c0dc3e63d087 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/ips" status: 200 len: 151 microversion: 2.20 time: 0.055272 Jan 18 20:25:23.086430 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 199/388] 10.222.0.67 () {60 vars in 1288 bytes} [Tue Jan 18 20:25:23 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/ips => generated 151 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:25:24.769041 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-c01eb8b9-0226-4ebb-9513-3890194c54af tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:24.770424 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-c01eb8b9-0226-4ebb-9513-3890194c54af tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:24.778504 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c01eb8b9-0226-4ebb-9513-3890194c54af tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:24.778948 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c01eb8b9-0226-4ebb-9513-3890194c54af tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:24.780378 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c01eb8b9-0226-4ebb-9513-3890194c54af tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:24.780826 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c01eb8b9-0226-4ebb-9513-3890194c54af tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:24.811505 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.objects.instance [None req-c01eb8b9-0226-4ebb-9513-3890194c54af tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lazy-loading 'flavor' on Instance uuid 712e0492-0709-4ab3-a1e2-5999b562d3fc {{(pid=116376) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:25:25.073006 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-c01eb8b9-0226-4ebb-9513-3890194c54af tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "POST /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/action" status: 200 len: 32 microversion: 2.1 time: 0.310179 Jan 18 20:25:25.073970 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 190/389] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:24 2022] POST /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/action => generated 32 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 18 20:25:25.093387 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a63fcf47-cd12-4932-8a98-e0c9536d58ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:25.095592 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a63fcf47-cd12-4932-8a98-e0c9536d58ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:25.108363 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a63fcf47-cd12-4932-8a98-e0c9536d58ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:25.109172 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a63fcf47-cd12-4932-8a98-e0c9536d58ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:25.110700 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a63fcf47-cd12-4932-8a98-e0c9536d58ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:25.111890 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a63fcf47-cd12-4932-8a98-e0c9536d58ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:25.350058 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a63fcf47-cd12-4932-8a98-e0c9536d58ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:25.359788 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a63fcf47-cd12-4932-8a98-e0c9536d58ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.277504 Jan 18 20:25:25.360550 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 200/390] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:25 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:25.597643 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-bd1110b5-c68c-46a8-8907-7f7cc8ea8752 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:25.598309 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-bd1110b5-c68c-46a8-8907-7f7cc8ea8752 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:25.605035 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bd1110b5-c68c-46a8-8907-7f7cc8ea8752 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:25.605837 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bd1110b5-c68c-46a8-8907-7f7cc8ea8752 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:25.606873 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bd1110b5-c68c-46a8-8907-7f7cc8ea8752 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:25.607380 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bd1110b5-c68c-46a8-8907-7f7cc8ea8752 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:25.656781 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.objects.instance [None req-bd1110b5-c68c-46a8-8907-7f7cc8ea8752 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lazy-loading 'flavor' on Instance uuid 54f16911-8813-49b1-a940-9d83c6a5b131 {{(pid=116376) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:25:25.693576 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9dd7e1cb-f713-432f-bf35-d5f0e038ba1f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b08228c9-f2ea-476f-ae85-bc9b98a7b338"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:25.694693 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9dd7e1cb-f713-432f-bf35-d5f0e038ba1f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:25.706763 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9dd7e1cb-f713-432f-bf35-d5f0e038ba1f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:25.708957 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9dd7e1cb-f713-432f-bf35-d5f0e038ba1f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:25.711734 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9dd7e1cb-f713-432f-bf35-d5f0e038ba1f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:25.712220 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9dd7e1cb-f713-432f-bf35-d5f0e038ba1f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:26.150047 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-bd1110b5-c68c-46a8-8907-7f7cc8ea8752 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 202 len: 0 microversion: 2.20 time: 0.556767 Jan 18 20:25:26.150672 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9dd7e1cb-f713-432f-bf35-d5f0e038ba1f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.461433 Jan 18 20:25:26.151226 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 191/391] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:25:25 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:25:26.151437 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 201/392] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Jan 18 20:25:25 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/os-volume_attachments => generated 194 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:25:26.168194 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-392e29a1-fc77-408e-80a1-94850bcb823e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:26.169882 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-392e29a1-fc77-408e-80a1-94850bcb823e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:26.185334 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-392e29a1-fc77-408e-80a1-94850bcb823e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:26.186020 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-392e29a1-fc77-408e-80a1-94850bcb823e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:26.187756 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-392e29a1-fc77-408e-80a1-94850bcb823e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:26.188856 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-392e29a1-fc77-408e-80a1-94850bcb823e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:26.390670 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ab026f61-b6fe-46a8-87cb-4875a538bed4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:26.392554 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ab026f61-b6fe-46a8-87cb-4875a538bed4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:26.401166 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-392e29a1-fc77-408e-80a1-94850bcb823e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:26.402961 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ab026f61-b6fe-46a8-87cb-4875a538bed4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:26.403791 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ab026f61-b6fe-46a8-87cb-4875a538bed4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:26.404981 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ab026f61-b6fe-46a8-87cb-4875a538bed4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:26.405831 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ab026f61-b6fe-46a8-87cb-4875a538bed4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:26.412395 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-392e29a1-fc77-408e-80a1-94850bcb823e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:26.414354 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-392e29a1-fc77-408e-80a1-94850bcb823e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:26.416054 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-392e29a1-fc77-408e-80a1-94850bcb823e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.255433 Jan 18 20:25:26.417162 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 192/393] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:26 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:26.588199 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ab026f61-b6fe-46a8-87cb-4875a538bed4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:26.596823 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ab026f61-b6fe-46a8-87cb-4875a538bed4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.214048 Jan 18 20:25:26.597439 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 202/394] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:26 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:27.436554 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a7e17748-0f2e-4532-9f0e-dd4ac7011a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:27.437274 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-a7e17748-0f2e-4532-9f0e-dd4ac7011a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:27.445275 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a7e17748-0f2e-4532-9f0e-dd4ac7011a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:27.445832 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a7e17748-0f2e-4532-9f0e-dd4ac7011a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:27.446691 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a7e17748-0f2e-4532-9f0e-dd4ac7011a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:27.447254 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a7e17748-0f2e-4532-9f0e-dd4ac7011a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:27.602942 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a7e17748-0f2e-4532-9f0e-dd4ac7011a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:27.613722 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a7e17748-0f2e-4532-9f0e-dd4ac7011a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:27.615728 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4b39bc50-07b7-41fe-8bd2-82d41530de31 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:27.616826 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a7e17748-0f2e-4532-9f0e-dd4ac7011a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:27.617074 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4b39bc50-07b7-41fe-8bd2-82d41530de31 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:27.617807 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a7e17748-0f2e-4532-9f0e-dd4ac7011a3b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.185226 Jan 18 20:25:27.618690 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 193/395] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:27 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:27.628408 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4b39bc50-07b7-41fe-8bd2-82d41530de31 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:27.629262 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4b39bc50-07b7-41fe-8bd2-82d41530de31 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:27.631069 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4b39bc50-07b7-41fe-8bd2-82d41530de31 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:27.631883 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4b39bc50-07b7-41fe-8bd2-82d41530de31 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:27.794697 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4b39bc50-07b7-41fe-8bd2-82d41530de31 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:27.810739 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4b39bc50-07b7-41fe-8bd2-82d41530de31 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.199289 Jan 18 20:25:27.811790 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 203/396] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:27 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:28.647477 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5c604fd8-db52-42e5-bf1a-f8b28d67571c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:28.648064 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-5c604fd8-db52-42e5-bf1a-f8b28d67571c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:28.655091 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5c604fd8-db52-42e5-bf1a-f8b28d67571c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:28.655546 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5c604fd8-db52-42e5-bf1a-f8b28d67571c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:28.656362 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5c604fd8-db52-42e5-bf1a-f8b28d67571c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:28.656799 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5c604fd8-db52-42e5-bf1a-f8b28d67571c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:28.830290 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-5c604fd8-db52-42e5-bf1a-f8b28d67571c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:28.836320 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-92ab506b-9b2a-449c-a63d-b952da003c68 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:28.837156 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-92ab506b-9b2a-449c-a63d-b952da003c68 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:28.844764 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92ab506b-9b2a-449c-a63d-b952da003c68 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:28.845890 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92ab506b-9b2a-449c-a63d-b952da003c68 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:28.846810 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92ab506b-9b2a-449c-a63d-b952da003c68 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:28.847296 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92ab506b-9b2a-449c-a63d-b952da003c68 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:28.847836 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-5c604fd8-db52-42e5-bf1a-f8b28d67571c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:28.850610 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-5c604fd8-db52-42e5-bf1a-f8b28d67571c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:28.852744 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-5c604fd8-db52-42e5-bf1a-f8b28d67571c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.208954 Jan 18 20:25:28.857607 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 194/397] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:28 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:25:29.026144 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-92ab506b-9b2a-449c-a63d-b952da003c68 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:29.038122 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-92ab506b-9b2a-449c-a63d-b952da003c68 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.207117 Jan 18 20:25:29.038741 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 204/398] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:28 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:29.881908 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-49900cc5-a13b-49ef-a006-b2e2f1295758 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:29.882789 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-49900cc5-a13b-49ef-a006-b2e2f1295758 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:29.890405 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-49900cc5-a13b-49ef-a006-b2e2f1295758 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:29.891147 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-49900cc5-a13b-49ef-a006-b2e2f1295758 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:29.892175 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-49900cc5-a13b-49ef-a006-b2e2f1295758 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:29.892781 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-49900cc5-a13b-49ef-a006-b2e2f1295758 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:30.057403 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-28653120-f033-430a-9715-e7f4d2b62b15 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:30.058217 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-28653120-f033-430a-9715-e7f4d2b62b15 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:30.066155 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-28653120-f033-430a-9715-e7f4d2b62b15 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:30.066968 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-28653120-f033-430a-9715-e7f4d2b62b15 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:30.067976 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-28653120-f033-430a-9715-e7f4d2b62b15 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:30.068641 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-28653120-f033-430a-9715-e7f4d2b62b15 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:30.072706 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-49900cc5-a13b-49ef-a006-b2e2f1295758 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:30.092155 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-49900cc5-a13b-49ef-a006-b2e2f1295758 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:30.096068 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-49900cc5-a13b-49ef-a006-b2e2f1295758 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:30.098747 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-49900cc5-a13b-49ef-a006-b2e2f1295758 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.223129 Jan 18 20:25:30.104771 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 195/399] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:29 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:30.243822 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-28653120-f033-430a-9715-e7f4d2b62b15 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:30.253308 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-28653120-f033-430a-9715-e7f4d2b62b15 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.200070 Jan 18 20:25:30.254011 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 205/400] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:30 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:31.130370 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-1994953a-e974-4483-b06d-408ed387c78b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:31.131402 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-1994953a-e974-4483-b06d-408ed387c78b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:31.138946 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1994953a-e974-4483-b06d-408ed387c78b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:31.139428 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1994953a-e974-4483-b06d-408ed387c78b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:31.140232 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1994953a-e974-4483-b06d-408ed387c78b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:31.140669 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1994953a-e974-4483-b06d-408ed387c78b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:31.273464 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0252fd10-462f-4064-a94d-760cc2e9a731 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:31.274596 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0252fd10-462f-4064-a94d-760cc2e9a731 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:31.287194 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0252fd10-462f-4064-a94d-760cc2e9a731 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:31.287993 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0252fd10-462f-4064-a94d-760cc2e9a731 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:31.289569 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0252fd10-462f-4064-a94d-760cc2e9a731 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:31.290239 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0252fd10-462f-4064-a94d-760cc2e9a731 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:31.370513 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-1994953a-e974-4483-b06d-408ed387c78b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:31.382991 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-1994953a-e974-4483-b06d-408ed387c78b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:31.385665 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-1994953a-e974-4483-b06d-408ed387c78b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:31.387926 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-1994953a-e974-4483-b06d-408ed387c78b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.262398 Jan 18 20:25:31.388872 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 196/401] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:31 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:31.473322 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-3b277f3f-dab1-4d37-b379-85b06951c6a1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:31.474170 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-3b277f3f-dab1-4d37-b379-85b06951c6a1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:31.484210 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3b277f3f-dab1-4d37-b379-85b06951c6a1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:31.484667 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3b277f3f-dab1-4d37-b379-85b06951c6a1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:31.485533 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3b277f3f-dab1-4d37-b379-85b06951c6a1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:31.485974 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3b277f3f-dab1-4d37-b379-85b06951c6a1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:31.509090 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0252fd10-462f-4064-a94d-760cc2e9a731 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:31.525305 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0252fd10-462f-4064-a94d-760cc2e9a731 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.258452 Jan 18 20:25:31.526272 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 206/402] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:31 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:31.617520 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.objects.instance [None req-3b277f3f-dab1-4d37-b379-85b06951c6a1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lazy-loading 'services' on Instance uuid 58ea4f41-f0e8-4630-94ce-903130658ff4 {{(pid=116376) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:25:31.701296 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-3b277f3f-dab1-4d37-b379-85b06951c6a1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "DELETE /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments/3a807034-e939-4361-ab87-040224645b0e" status: 202 len: 0 microversion: 2.1 time: 0.232935 Jan 18 20:25:31.702173 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 197/403] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Jan 18 20:25:31 2022] DELETE /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments/3a807034-e939-4361-ab87-040224645b0e => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:25:31.714069 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-366088f2-8010-4b85-9be1-6726ed198b25 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:31.715507 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-366088f2-8010-4b85-9be1-6726ed198b25 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:31.726433 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-366088f2-8010-4b85-9be1-6726ed198b25 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:31.727189 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-366088f2-8010-4b85-9be1-6726ed198b25 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:31.728803 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-366088f2-8010-4b85-9be1-6726ed198b25 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:31.729753 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-366088f2-8010-4b85-9be1-6726ed198b25 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:31.781971 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-366088f2-8010-4b85-9be1-6726ed198b25 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073028 Jan 18 20:25:31.783560 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 207/404] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:25:31 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:25:32.413598 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-623b3ab8-7175-49f9-8694-06aaefafb488 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:32.414307 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-623b3ab8-7175-49f9-8694-06aaefafb488 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:32.421532 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-623b3ab8-7175-49f9-8694-06aaefafb488 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:32.422156 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-623b3ab8-7175-49f9-8694-06aaefafb488 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:32.423266 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-623b3ab8-7175-49f9-8694-06aaefafb488 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:32.423708 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-623b3ab8-7175-49f9-8694-06aaefafb488 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:32.544613 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6ad5adae-2443-4ba2-bcff-06311f9bfff1 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:32.545344 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6ad5adae-2443-4ba2-bcff-06311f9bfff1 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:32.555251 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6ad5adae-2443-4ba2-bcff-06311f9bfff1 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:32.556004 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6ad5adae-2443-4ba2-bcff-06311f9bfff1 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:32.557240 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6ad5adae-2443-4ba2-bcff-06311f9bfff1 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:32.557899 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6ad5adae-2443-4ba2-bcff-06311f9bfff1 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:32.579991 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-623b3ab8-7175-49f9-8694-06aaefafb488 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:32.589790 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-623b3ab8-7175-49f9-8694-06aaefafb488 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:32.592165 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-623b3ab8-7175-49f9-8694-06aaefafb488 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:32.593541 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-623b3ab8-7175-49f9-8694-06aaefafb488 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.184908 Jan 18 20:25:32.595578 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 198/405] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:32 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:25:32.720879 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6ad5adae-2443-4ba2-bcff-06311f9bfff1 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:32.731259 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6ad5adae-2443-4ba2-bcff-06311f9bfff1 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.190907 Jan 18 20:25:32.731863 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 208/406] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:32 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:32.796607 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-df4e8fb8-5db8-4fe4-833b-4ba20bcfd7f0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:32.797658 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-df4e8fb8-5db8-4fe4-833b-4ba20bcfd7f0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:32.806066 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-df4e8fb8-5db8-4fe4-833b-4ba20bcfd7f0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:32.806515 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-df4e8fb8-5db8-4fe4-833b-4ba20bcfd7f0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:32.807415 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-df4e8fb8-5db8-4fe4-833b-4ba20bcfd7f0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:32.807885 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-df4e8fb8-5db8-4fe4-833b-4ba20bcfd7f0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:32.841463 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-df4e8fb8-5db8-4fe4-833b-4ba20bcfd7f0 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049593 Jan 18 20:25:32.842080 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 199/407] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:25:32 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:25:33.621574 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b4fdd4af-f570-4e20-9f66-a8371eabe780 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:33.622144 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b4fdd4af-f570-4e20-9f66-a8371eabe780 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:33.630328 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b4fdd4af-f570-4e20-9f66-a8371eabe780 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:33.630803 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b4fdd4af-f570-4e20-9f66-a8371eabe780 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:33.631756 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b4fdd4af-f570-4e20-9f66-a8371eabe780 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:33.632224 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b4fdd4af-f570-4e20-9f66-a8371eabe780 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:33.752150 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7c7e0f2a-448b-46c9-9bcc-f8bcbc30949e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:33.753186 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-7c7e0f2a-448b-46c9-9bcc-f8bcbc30949e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:33.760994 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7c7e0f2a-448b-46c9-9bcc-f8bcbc30949e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:33.761683 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7c7e0f2a-448b-46c9-9bcc-f8bcbc30949e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:33.763093 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7c7e0f2a-448b-46c9-9bcc-f8bcbc30949e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:33.763732 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7c7e0f2a-448b-46c9-9bcc-f8bcbc30949e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:33.813101 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b4fdd4af-f570-4e20-9f66-a8371eabe780 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:33.822023 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b4fdd4af-f570-4e20-9f66-a8371eabe780 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:33.823640 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b4fdd4af-f570-4e20-9f66-a8371eabe780 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:33.824828 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b4fdd4af-f570-4e20-9f66-a8371eabe780 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.207529 Jan 18 20:25:33.825496 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 209/408] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:33 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:33.859202 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-04a2d56f-bd94-48e2-a9b9-31f8419a8442 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:33.861484 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-04a2d56f-bd94-48e2-a9b9-31f8419a8442 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:33.871665 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-04a2d56f-bd94-48e2-a9b9-31f8419a8442 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:33.872349 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-04a2d56f-bd94-48e2-a9b9-31f8419a8442 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:33.873723 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-04a2d56f-bd94-48e2-a9b9-31f8419a8442 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:33.874655 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-04a2d56f-bd94-48e2-a9b9-31f8419a8442 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:33.919548 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-04a2d56f-bd94-48e2-a9b9-31f8419a8442 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068700 Jan 18 20:25:33.920142 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 210/409] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:25:33 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:25:33.960326 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-7c7e0f2a-448b-46c9-9bcc-f8bcbc30949e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:33.969247 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7c7e0f2a-448b-46c9-9bcc-f8bcbc30949e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.222679 Jan 18 20:25:33.970608 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 200/410] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:33 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:34.843789 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1d3bdf34-cefb-470f-a0bd-88f96ec963fd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:34.844485 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1d3bdf34-cefb-470f-a0bd-88f96ec963fd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:34.853701 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1d3bdf34-cefb-470f-a0bd-88f96ec963fd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:34.854148 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1d3bdf34-cefb-470f-a0bd-88f96ec963fd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:34.855148 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1d3bdf34-cefb-470f-a0bd-88f96ec963fd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:34.855871 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1d3bdf34-cefb-470f-a0bd-88f96ec963fd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:34.936207 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-66f58e8e-c7ce-4cd5-ad05-5c62cddb7ecb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:34.938342 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-66f58e8e-c7ce-4cd5-ad05-5c62cddb7ecb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:34.953903 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-66f58e8e-c7ce-4cd5-ad05-5c62cddb7ecb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:34.954773 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-66f58e8e-c7ce-4cd5-ad05-5c62cddb7ecb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:34.956505 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-66f58e8e-c7ce-4cd5-ad05-5c62cddb7ecb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:34.957415 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-66f58e8e-c7ce-4cd5-ad05-5c62cddb7ecb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:35.013788 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-66f58e8e-c7ce-4cd5-ad05-5c62cddb7ecb tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084225 Jan 18 20:25:35.014774 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 201/411] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:25:34 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:25:35.025473 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-dcfd0f17-4e6c-492f-a206-5527679d994b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:35.026992 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-dcfd0f17-4e6c-492f-a206-5527679d994b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:35.041875 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dcfd0f17-4e6c-492f-a206-5527679d994b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:35.043124 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dcfd0f17-4e6c-492f-a206-5527679d994b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:35.045110 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dcfd0f17-4e6c-492f-a206-5527679d994b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:35.046176 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dcfd0f17-4e6c-492f-a206-5527679d994b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:35.056965 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1d3bdf34-cefb-470f-a0bd-88f96ec963fd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:35.072259 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1d3bdf34-cefb-470f-a0bd-88f96ec963fd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:35.075832 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1d3bdf34-cefb-470f-a0bd-88f96ec963fd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:35.078106 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1d3bdf34-cefb-470f-a0bd-88f96ec963fd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.238244 Jan 18 20:25:35.079321 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 211/412] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:34 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:35.231402 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-dcfd0f17-4e6c-492f-a206-5527679d994b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:35.245812 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-dcfd0f17-4e6c-492f-a206-5527679d994b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.229415 Jan 18 20:25:35.246751 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 202/413] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:35 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:36.028500 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-39be1dd8-5e6a-484e-a2c4-ec571e570ead tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:36.029783 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-39be1dd8-5e6a-484e-a2c4-ec571e570ead tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:36.037336 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-39be1dd8-5e6a-484e-a2c4-ec571e570ead tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:36.037953 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-39be1dd8-5e6a-484e-a2c4-ec571e570ead tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:36.038862 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-39be1dd8-5e6a-484e-a2c4-ec571e570ead tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:36.039432 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-39be1dd8-5e6a-484e-a2c4-ec571e570ead tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:36.078306 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-39be1dd8-5e6a-484e-a2c4-ec571e570ead tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050926 Jan 18 20:25:36.078974 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 212/414] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:25:36 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:25:36.101033 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-42739de2-bb39-4df5-84de-a4bbaccd99e3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:36.101655 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-42739de2-bb39-4df5-84de-a4bbaccd99e3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:36.109269 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-42739de2-bb39-4df5-84de-a4bbaccd99e3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:36.109736 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-42739de2-bb39-4df5-84de-a4bbaccd99e3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:36.111416 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-42739de2-bb39-4df5-84de-a4bbaccd99e3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:36.111889 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-42739de2-bb39-4df5-84de-a4bbaccd99e3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:36.264485 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-42739de2-bb39-4df5-84de-a4bbaccd99e3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:36.268875 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-27c69092-58fa-431c-9c44-e6d381358cd0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:36.269666 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-27c69092-58fa-431c-9c44-e6d381358cd0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:36.275176 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-42739de2-bb39-4df5-84de-a4bbaccd99e3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:36.276850 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-42739de2-bb39-4df5-84de-a4bbaccd99e3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:36.277208 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-27c69092-58fa-431c-9c44-e6d381358cd0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:36.277731 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-27c69092-58fa-431c-9c44-e6d381358cd0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:36.278072 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-42739de2-bb39-4df5-84de-a4bbaccd99e3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.181274 Jan 18 20:25:36.278765 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 203/415] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:36 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:36.278962 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-27c69092-58fa-431c-9c44-e6d381358cd0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:36.279363 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-27c69092-58fa-431c-9c44-e6d381358cd0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:36.439854 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-27c69092-58fa-431c-9c44-e6d381358cd0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:36.448887 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-27c69092-58fa-431c-9c44-e6d381358cd0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.186178 Jan 18 20:25:36.449478 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 213/416] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:36 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:37.090698 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e109743a-13e7-4017-83e3-3a2ba7c23eb9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:37.091958 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e109743a-13e7-4017-83e3-3a2ba7c23eb9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:37.100375 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e109743a-13e7-4017-83e3-3a2ba7c23eb9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:37.100917 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e109743a-13e7-4017-83e3-3a2ba7c23eb9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:37.101776 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e109743a-13e7-4017-83e3-3a2ba7c23eb9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:37.102332 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e109743a-13e7-4017-83e3-3a2ba7c23eb9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:37.137156 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e109743a-13e7-4017-83e3-3a2ba7c23eb9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050688 Jan 18 20:25:37.137650 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 204/417] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:25:37 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:25:37.297462 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2b1a4474-08d5-4e81-97ed-be2e33a99096 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:37.298166 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2b1a4474-08d5-4e81-97ed-be2e33a99096 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:37.306418 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b1a4474-08d5-4e81-97ed-be2e33a99096 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:37.306860 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b1a4474-08d5-4e81-97ed-be2e33a99096 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:37.307716 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b1a4474-08d5-4e81-97ed-be2e33a99096 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:37.308150 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b1a4474-08d5-4e81-97ed-be2e33a99096 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:37.454640 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2b1a4474-08d5-4e81-97ed-be2e33a99096 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:37.463480 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2b1a4474-08d5-4e81-97ed-be2e33a99096 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:37.464672 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2b1a4474-08d5-4e81-97ed-be2e33a99096 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:37.465862 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2b1a4474-08d5-4e81-97ed-be2e33a99096 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.172391 Jan 18 20:25:37.466528 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 214/418] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:37 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:37.467232 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f98d99af-e2f8-4303-b795-d63b649c1411 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:37.468353 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-f98d99af-e2f8-4303-b795-d63b649c1411 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:37.479600 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f98d99af-e2f8-4303-b795-d63b649c1411 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:37.480401 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f98d99af-e2f8-4303-b795-d63b649c1411 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:37.481864 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f98d99af-e2f8-4303-b795-d63b649c1411 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:37.482656 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f98d99af-e2f8-4303-b795-d63b649c1411 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:37.652200 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-f98d99af-e2f8-4303-b795-d63b649c1411 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:37.672026 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-f98d99af-e2f8-4303-b795-d63b649c1411 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.209286 Jan 18 20:25:37.687067 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 205/419] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:37 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:38.077533 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b915642b-ab56-499b-9dfd-3a58a437882b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:38.087845 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b915642b-ab56-499b-9dfd-3a58a437882b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:38.088554 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b915642b-ab56-499b-9dfd-3a58a437882b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:38.149390 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-25070cac-a761-4b61-a66c-c0b69ec69337 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:38.150601 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-25070cac-a761-4b61-a66c-c0b69ec69337 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:38.159132 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-25070cac-a761-4b61-a66c-c0b69ec69337 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:38.159718 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-25070cac-a761-4b61-a66c-c0b69ec69337 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:38.160787 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-25070cac-a761-4b61-a66c-c0b69ec69337 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:38.161529 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-25070cac-a761-4b61-a66c-c0b69ec69337 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:38.169593 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b915642b-ab56-499b-9dfd-3a58a437882b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Going to try to stop instance {{(pid=116375) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 18 20:25:38.201869 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-25070cac-a761-4b61-a66c-c0b69ec69337 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056247 Jan 18 20:25:38.202499 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 206/420] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:25:38 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:25:38.239745 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b915642b-ab56-499b-9dfd-3a58a437882b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 202 len: 0 microversion: 2.1 time: 0.168127 Jan 18 20:25:38.241196 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 215/421] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:38 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:25:38.249830 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-8b4946aa-c5a0-40bf-9f81-7ff1a6e83157 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:38.250452 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-8b4946aa-c5a0-40bf-9f81-7ff1a6e83157 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:38.260559 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8b4946aa-c5a0-40bf-9f81-7ff1a6e83157 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:38.261342 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8b4946aa-c5a0-40bf-9f81-7ff1a6e83157 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:38.262842 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8b4946aa-c5a0-40bf-9f81-7ff1a6e83157 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:38.263946 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8b4946aa-c5a0-40bf-9f81-7ff1a6e83157 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:38.447765 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-8b4946aa-c5a0-40bf-9f81-7ff1a6e83157 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:38.458507 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-8b4946aa-c5a0-40bf-9f81-7ff1a6e83157 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1722 microversion: 2.1 time: 0.212162 Jan 18 20:25:38.459117 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 207/422] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:38 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:38.499318 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0fa798b3-63fb-4196-8992-e13413da4a47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:38.500437 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0fa798b3-63fb-4196-8992-e13413da4a47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:38.508400 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0fa798b3-63fb-4196-8992-e13413da4a47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:38.509072 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0fa798b3-63fb-4196-8992-e13413da4a47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:38.510255 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0fa798b3-63fb-4196-8992-e13413da4a47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:38.510807 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0fa798b3-63fb-4196-8992-e13413da4a47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:38.674297 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0fa798b3-63fb-4196-8992-e13413da4a47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:38.683839 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0fa798b3-63fb-4196-8992-e13413da4a47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:38.685900 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0fa798b3-63fb-4196-8992-e13413da4a47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:38.687295 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0fa798b3-63fb-4196-8992-e13413da4a47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.195962 Jan 18 20:25:38.688067 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 216/423] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:38 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:38.702468 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-3c18fcb9-a9ce-422c-b53e-536555f5db10 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:38.703217 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-3c18fcb9-a9ce-422c-b53e-536555f5db10 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:38.712761 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3c18fcb9-a9ce-422c-b53e-536555f5db10 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:38.713585 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3c18fcb9-a9ce-422c-b53e-536555f5db10 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:38.714096 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3c18fcb9-a9ce-422c-b53e-536555f5db10 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:38.714623 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3c18fcb9-a9ce-422c-b53e-536555f5db10 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:38.901375 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-3c18fcb9-a9ce-422c-b53e-536555f5db10 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:38.910527 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-3c18fcb9-a9ce-422c-b53e-536555f5db10 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.213613 Jan 18 20:25:38.911137 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 208/424] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:38 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:39.217443 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-26062092-ce68-4d3e-82cb-91d369b6f2a7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:39.218463 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-26062092-ce68-4d3e-82cb-91d369b6f2a7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:39.225884 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-26062092-ce68-4d3e-82cb-91d369b6f2a7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:39.226265 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-26062092-ce68-4d3e-82cb-91d369b6f2a7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:39.227133 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-26062092-ce68-4d3e-82cb-91d369b6f2a7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:39.227609 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-26062092-ce68-4d3e-82cb-91d369b6f2a7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:39.261467 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-26062092-ce68-4d3e-82cb-91d369b6f2a7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047949 Jan 18 20:25:39.262467 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 217/425] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:25:39 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:25:39.476625 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-c57aadb8-a2c7-4d80-9e58-9ce14ae58cc7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:39.477185 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-c57aadb8-a2c7-4d80-9e58-9ce14ae58cc7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:39.487895 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c57aadb8-a2c7-4d80-9e58-9ce14ae58cc7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:39.489271 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c57aadb8-a2c7-4d80-9e58-9ce14ae58cc7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:39.491128 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c57aadb8-a2c7-4d80-9e58-9ce14ae58cc7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:39.491580 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c57aadb8-a2c7-4d80-9e58-9ce14ae58cc7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:39.649169 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-c57aadb8-a2c7-4d80-9e58-9ce14ae58cc7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:39.657196 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-c57aadb8-a2c7-4d80-9e58-9ce14ae58cc7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1722 microversion: 2.1 time: 0.184348 Jan 18 20:25:39.657773 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 209/426] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:39 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:39.716830 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-49fc466a-a0cf-4441-a149-b5157353c9e7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:39.717853 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-49fc466a-a0cf-4441-a149-b5157353c9e7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:39.726245 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-49fc466a-a0cf-4441-a149-b5157353c9e7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:39.726987 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-49fc466a-a0cf-4441-a149-b5157353c9e7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:39.728230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-49fc466a-a0cf-4441-a149-b5157353c9e7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:39.729064 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-49fc466a-a0cf-4441-a149-b5157353c9e7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:39.905589 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-49fc466a-a0cf-4441-a149-b5157353c9e7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:39.915879 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-49fc466a-a0cf-4441-a149-b5157353c9e7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:39.917451 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-49fc466a-a0cf-4441-a149-b5157353c9e7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:39.918692 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-49fc466a-a0cf-4441-a149-b5157353c9e7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.206644 Jan 18 20:25:39.919360 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 218/427] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:39 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:39.932815 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b5b885b8-ed18-4e1e-a612-845a09b86f4c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:39.933927 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b5b885b8-ed18-4e1e-a612-845a09b86f4c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:39.942034 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b5b885b8-ed18-4e1e-a612-845a09b86f4c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:39.942526 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b5b885b8-ed18-4e1e-a612-845a09b86f4c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:39.943531 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b5b885b8-ed18-4e1e-a612-845a09b86f4c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:39.944010 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b5b885b8-ed18-4e1e-a612-845a09b86f4c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:40.120107 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b5b885b8-ed18-4e1e-a612-845a09b86f4c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:40.129490 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b5b885b8-ed18-4e1e-a612-845a09b86f4c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.203147 Jan 18 20:25:40.130110 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 210/428] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:39 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:40.481755 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-effc369a-920a-4f22-a892-cbdc8e3d003c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:40.482594 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-effc369a-920a-4f22-a892-cbdc8e3d003c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:40.490434 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-effc369a-920a-4f22-a892-cbdc8e3d003c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:40.491233 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-effc369a-920a-4f22-a892-cbdc8e3d003c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:40.492462 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-effc369a-920a-4f22-a892-cbdc8e3d003c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:40.493028 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-effc369a-920a-4f22-a892-cbdc8e3d003c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:40.544439 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-effc369a-920a-4f22-a892-cbdc8e3d003c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:25:40.680900 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fac555af-80a1-4f56-a1e8-85addd824b86 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:40.681849 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-fac555af-80a1-4f56-a1e8-85addd824b86 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:40.703152 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fac555af-80a1-4f56-a1e8-85addd824b86 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:40.703618 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fac555af-80a1-4f56-a1e8-85addd824b86 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:40.705143 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fac555af-80a1-4f56-a1e8-85addd824b86 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:40.705687 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fac555af-80a1-4f56-a1e8-85addd824b86 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:40.706748 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-effc369a-920a-4f22-a892-cbdc8e3d003c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "DELETE /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 204 len: 0 microversion: 2.1 time: 0.228446 Jan 18 20:25:40.712857 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 219/429] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:25:40 2022] DELETE /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:25:40.722844 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c0339700-337c-4abf-903f-161ffbe08668 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:40.724250 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c0339700-337c-4abf-903f-161ffbe08668 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:40.735474 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0339700-337c-4abf-903f-161ffbe08668 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:40.736565 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0339700-337c-4abf-903f-161ffbe08668 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:40.738128 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0339700-337c-4abf-903f-161ffbe08668 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:40.739104 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0339700-337c-4abf-903f-161ffbe08668 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:40.956857 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c0339700-337c-4abf-903f-161ffbe08668 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:40.972810 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c0339700-337c-4abf-903f-161ffbe08668 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1513 microversion: 2.1 time: 0.257685 Jan 18 20:25:40.973724 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 220/430] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:40 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:40.991530 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c572693c-f31e-41a0-a897-4bbbe045bc03 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:40.991530 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c572693c-f31e-41a0-a897-4bbbe045bc03 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:40.998317 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c572693c-f31e-41a0-a897-4bbbe045bc03 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:40.998850 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c572693c-f31e-41a0-a897-4bbbe045bc03 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:40.999724 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c572693c-f31e-41a0-a897-4bbbe045bc03 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:41.000202 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c572693c-f31e-41a0-a897-4bbbe045bc03 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:41.002909 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-fac555af-80a1-4f56-a1e8-85addd824b86 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:41.014217 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-fac555af-80a1-4f56-a1e8-85addd824b86 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1722 microversion: 2.1 time: 0.337536 Jan 18 20:25:41.015630 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 211/431] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:40 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1722 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:41.147655 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fb2a6dec-b4ec-4ecb-9640-db5ddce3af3d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:41.148186 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-fb2a6dec-b4ec-4ecb-9640-db5ddce3af3d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:41.154663 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fb2a6dec-b4ec-4ecb-9640-db5ddce3af3d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:41.155506 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fb2a6dec-b4ec-4ecb-9640-db5ddce3af3d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:41.156477 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fb2a6dec-b4ec-4ecb-9640-db5ddce3af3d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:41.156879 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fb2a6dec-b4ec-4ecb-9640-db5ddce3af3d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:41.174814 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c572693c-f31e-41a0-a897-4bbbe045bc03 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:41.183152 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c572693c-f31e-41a0-a897-4bbbe045bc03 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:41.184668 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c572693c-f31e-41a0-a897-4bbbe045bc03 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:41.185836 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c572693c-f31e-41a0-a897-4bbbe045bc03 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.210509 Jan 18 20:25:41.186403 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 221/432] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:40 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:41.307592 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-fb2a6dec-b4ec-4ecb-9640-db5ddce3af3d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:41.322620 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-fb2a6dec-b4ec-4ecb-9640-db5ddce3af3d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.178594 Jan 18 20:25:41.323770 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 212/433] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:41 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:41.999119 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fa20032e-8e2f-46a0-a4f5-740b7f0f1eb7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:41.999670 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fa20032e-8e2f-46a0-a4f5-740b7f0f1eb7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:42.006868 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa20032e-8e2f-46a0-a4f5-740b7f0f1eb7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:42.007358 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa20032e-8e2f-46a0-a4f5-740b7f0f1eb7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:42.008160 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa20032e-8e2f-46a0-a4f5-740b7f0f1eb7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:42.008593 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa20032e-8e2f-46a0-a4f5-740b7f0f1eb7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:42.033521 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d27ef4d6-e7e5-4341-b1da-ad41665a66ab tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:42.034224 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d27ef4d6-e7e5-4341-b1da-ad41665a66ab tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:42.041528 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d27ef4d6-e7e5-4341-b1da-ad41665a66ab tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:42.041978 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d27ef4d6-e7e5-4341-b1da-ad41665a66ab tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:42.042786 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d27ef4d6-e7e5-4341-b1da-ad41665a66ab tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:42.043255 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d27ef4d6-e7e5-4341-b1da-ad41665a66ab tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:42.173865 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fa20032e-8e2f-46a0-a4f5-740b7f0f1eb7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:42.182853 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fa20032e-8e2f-46a0-a4f5-740b7f0f1eb7 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1513 microversion: 2.1 time: 0.187227 Jan 18 20:25:42.184010 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 222/434] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:41 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:42.204949 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d27ef4d6-e7e5-4341-b1da-ad41665a66ab tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:42.211881 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-23af1d84-9821-484d-9e8f-2203f2538962 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:42.212485 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-23af1d84-9821-484d-9e8f-2203f2538962 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:42.213592 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d27ef4d6-e7e5-4341-b1da-ad41665a66ab tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1722 microversion: 2.1 time: 0.183910 Jan 18 20:25:42.214515 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 213/435] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:42 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:42.219924 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-23af1d84-9821-484d-9e8f-2203f2538962 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:42.220387 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-23af1d84-9821-484d-9e8f-2203f2538962 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:42.221195 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-23af1d84-9821-484d-9e8f-2203f2538962 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:42.221630 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-23af1d84-9821-484d-9e8f-2203f2538962 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:42.350163 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b91d1a81-c894-404d-930d-e798ec34c6ba tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:42.351326 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b91d1a81-c894-404d-930d-e798ec34c6ba tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:42.362492 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b91d1a81-c894-404d-930d-e798ec34c6ba tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:42.363252 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b91d1a81-c894-404d-930d-e798ec34c6ba tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:42.364720 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b91d1a81-c894-404d-930d-e798ec34c6ba tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:42.365827 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b91d1a81-c894-404d-930d-e798ec34c6ba tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:42.379946 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-23af1d84-9821-484d-9e8f-2203f2538962 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:42.393645 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-23af1d84-9821-484d-9e8f-2203f2538962 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:42.396652 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-23af1d84-9821-484d-9e8f-2203f2538962 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:42.398889 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-23af1d84-9821-484d-9e8f-2203f2538962 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.190480 Jan 18 20:25:42.399893 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 223/436] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:42 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:25:42.511380 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b91d1a81-c894-404d-930d-e798ec34c6ba tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:42.519919 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b91d1a81-c894-404d-930d-e798ec34c6ba tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.174358 Jan 18 20:25:42.520519 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 214/437] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:42 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:43.201011 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9ddfe6a2-bc79-41a4-b9ac-cb7f5c916b6c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:43.201688 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9ddfe6a2-bc79-41a4-b9ac-cb7f5c916b6c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:43.209069 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9ddfe6a2-bc79-41a4-b9ac-cb7f5c916b6c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:43.209523 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9ddfe6a2-bc79-41a4-b9ac-cb7f5c916b6c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:43.210309 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9ddfe6a2-bc79-41a4-b9ac-cb7f5c916b6c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:43.210749 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9ddfe6a2-bc79-41a4-b9ac-cb7f5c916b6c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:43.237768 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-35743ff5-e23d-49fd-8a5b-e944f429ec25 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:43.238759 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-35743ff5-e23d-49fd-8a5b-e944f429ec25 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:43.247920 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-35743ff5-e23d-49fd-8a5b-e944f429ec25 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:43.248357 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-35743ff5-e23d-49fd-8a5b-e944f429ec25 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:43.249141 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-35743ff5-e23d-49fd-8a5b-e944f429ec25 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:43.249570 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-35743ff5-e23d-49fd-8a5b-e944f429ec25 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:43.353937 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9ddfe6a2-bc79-41a4-b9ac-cb7f5c916b6c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:43.367844 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9ddfe6a2-bc79-41a4-b9ac-cb7f5c916b6c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1513 microversion: 2.1 time: 0.169970 Jan 18 20:25:43.368681 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 224/438] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:43 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:43.391472 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-35743ff5-e23d-49fd-8a5b-e944f429ec25 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:43.400019 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-35743ff5-e23d-49fd-8a5b-e944f429ec25 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1722 microversion: 2.1 time: 0.166125 Jan 18 20:25:43.400607 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 215/439] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:43 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:43.425123 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f8a8fd85-4abb-494a-85b4-fe50c049e266 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:43.425794 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f8a8fd85-4abb-494a-85b4-fe50c049e266 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:43.432076 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f8a8fd85-4abb-494a-85b4-fe50c049e266 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:43.432516 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f8a8fd85-4abb-494a-85b4-fe50c049e266 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:43.433306 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f8a8fd85-4abb-494a-85b4-fe50c049e266 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:43.433734 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f8a8fd85-4abb-494a-85b4-fe50c049e266 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:43.543624 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-3630523d-aaa3-417e-99c8-34a44328f5a9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:43.544342 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-3630523d-aaa3-417e-99c8-34a44328f5a9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:43.551899 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3630523d-aaa3-417e-99c8-34a44328f5a9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:43.552348 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3630523d-aaa3-417e-99c8-34a44328f5a9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:43.553138 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3630523d-aaa3-417e-99c8-34a44328f5a9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:43.553570 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3630523d-aaa3-417e-99c8-34a44328f5a9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:43.576657 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f8a8fd85-4abb-494a-85b4-fe50c049e266 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:43.591497 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f8a8fd85-4abb-494a-85b4-fe50c049e266 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:43.594560 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f8a8fd85-4abb-494a-85b4-fe50c049e266 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:43.595844 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f8a8fd85-4abb-494a-85b4-fe50c049e266 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.175324 Jan 18 20:25:43.596412 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 225/440] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:43 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:25:43.703451 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-3630523d-aaa3-417e-99c8-34a44328f5a9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:43.711972 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-3630523d-aaa3-417e-99c8-34a44328f5a9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.173828 Jan 18 20:25:43.712579 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 216/441] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:43 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:44.385060 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c297f1f5-c95d-4829-bb80-042a6ceff259 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:44.385692 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c297f1f5-c95d-4829-bb80-042a6ceff259 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:44.392329 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c297f1f5-c95d-4829-bb80-042a6ceff259 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:44.392780 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c297f1f5-c95d-4829-bb80-042a6ceff259 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:44.393582 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c297f1f5-c95d-4829-bb80-042a6ceff259 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:44.394017 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c297f1f5-c95d-4829-bb80-042a6ceff259 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:44.417296 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7199ef35-a9ba-4db1-b3d8-2f276812bb5b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:44.418051 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-7199ef35-a9ba-4db1-b3d8-2f276812bb5b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:44.425644 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7199ef35-a9ba-4db1-b3d8-2f276812bb5b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:44.426103 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7199ef35-a9ba-4db1-b3d8-2f276812bb5b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:44.426901 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7199ef35-a9ba-4db1-b3d8-2f276812bb5b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:44.427364 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7199ef35-a9ba-4db1-b3d8-2f276812bb5b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:44.553252 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c297f1f5-c95d-4829-bb80-042a6ceff259 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:44.566469 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c297f1f5-c95d-4829-bb80-042a6ceff259 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1513 microversion: 2.1 time: 0.184650 Jan 18 20:25:44.567541 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 226/442] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:44 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:44.615279 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-003d88c8-c3ef-4059-b22f-9cf9ad538f63 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:44.615905 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-003d88c8-c3ef-4059-b22f-9cf9ad538f63 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:44.622177 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-003d88c8-c3ef-4059-b22f-9cf9ad538f63 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:44.622633 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-003d88c8-c3ef-4059-b22f-9cf9ad538f63 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:44.623703 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-003d88c8-c3ef-4059-b22f-9cf9ad538f63 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:44.624165 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-003d88c8-c3ef-4059-b22f-9cf9ad538f63 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:44.681408 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-7199ef35-a9ba-4db1-b3d8-2f276812bb5b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:44.716944 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7199ef35-a9ba-4db1-b3d8-2f276812bb5b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1722 microversion: 2.1 time: 0.303086 Jan 18 20:25:44.718692 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 217/443] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:44 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:44.748424 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5ca68b24-35f5-4f59-96c8-a41082410ec6 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:44.749470 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-5ca68b24-35f5-4f59-96c8-a41082410ec6 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:44.756956 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5ca68b24-35f5-4f59-96c8-a41082410ec6 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:44.758316 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5ca68b24-35f5-4f59-96c8-a41082410ec6 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:44.759344 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5ca68b24-35f5-4f59-96c8-a41082410ec6 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:44.760003 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5ca68b24-35f5-4f59-96c8-a41082410ec6 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:44.826887 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-003d88c8-c3ef-4059-b22f-9cf9ad538f63 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:44.845275 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-003d88c8-c3ef-4059-b22f-9cf9ad538f63 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:44.847779 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-003d88c8-c3ef-4059-b22f-9cf9ad538f63 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:44.849359 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-003d88c8-c3ef-4059-b22f-9cf9ad538f63 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.238328 Jan 18 20:25:44.864439 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 227/444] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:44 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:25:45.323836 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-5ca68b24-35f5-4f59-96c8-a41082410ec6 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:45.334108 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-5ca68b24-35f5-4f59-96c8-a41082410ec6 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.600240 Jan 18 20:25:45.334922 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 218/445] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:44 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:45.470176 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-0d0cb0c1-aeb5-46cb-a87e-b06348469886 req-787ac6a4-c430-456e-b931-ed3af96c994e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ea4f41-f0e8-4630-94ce-903130658ff4", "name": "network-vif-deleted", "tag": "9574aa0a-7413-4cef-9d97-7a7b786add9a"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:45.471903 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:25:45.471903 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:25:45.480299 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-0d0cb0c1-aeb5-46cb-a87e-b06348469886 req-787ac6a4-c430-456e-b931-ed3af96c994e service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:45.480584 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-0d0cb0c1-aeb5-46cb-a87e-b06348469886 req-787ac6a4-c430-456e-b931-ed3af96c994e service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:45.494350 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-0d0cb0c1-aeb5-46cb-a87e-b06348469886 req-787ac6a4-c430-456e-b931-ed3af96c994e service nova] Creating event network-vif-deleted:9574aa0a-7413-4cef-9d97-7a7b786add9a for instance 58ea4f41-f0e8-4630-94ce-903130658ff4 on hv-cinder-82160 Jan 18 20:25:45.506102 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-0d0cb0c1-aeb5-46cb-a87e-b06348469886 req-787ac6a4-c430-456e-b931-ed3af96c994e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039048 Jan 18 20:25:45.508421 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 228/446] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:25:45.587906 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0af5b116-8fc6-47e7-983c-e0ff0d484fb3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:45.589305 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0af5b116-8fc6-47e7-983c-e0ff0d484fb3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:45.597417 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0af5b116-8fc6-47e7-983c-e0ff0d484fb3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:45.598299 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0af5b116-8fc6-47e7-983c-e0ff0d484fb3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:45.600299 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0af5b116-8fc6-47e7-983c-e0ff0d484fb3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:45.601488 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0af5b116-8fc6-47e7-983c-e0ff0d484fb3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:45.661498 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0af5b116-8fc6-47e7-983c-e0ff0d484fb3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:45.662297 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0af5b116-8fc6-47e7-983c-e0ff0d484fb3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:45.663165 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.objects.instance [None req-0af5b116-8fc6-47e7-983c-e0ff0d484fb3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lazy-loading 'fault' on Instance uuid 58ea4f41-f0e8-4630-94ce-903130658ff4 {{(pid=116376) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:25:45.731510 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-0af5b116-8fc6-47e7-983c-e0ff0d484fb3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:45.742339 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-71f40cef-e835-413c-b641-ee47880cd0e8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:45.743078 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-71f40cef-e835-413c-b641-ee47880cd0e8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:45.743926 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0af5b116-8fc6-47e7-983c-e0ff0d484fb3 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 200 len: 1308 microversion: 2.1 time: 0.161302 Jan 18 20:25:45.750101 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-71f40cef-e835-413c-b641-ee47880cd0e8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:45.750609 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-71f40cef-e835-413c-b641-ee47880cd0e8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:45.752012 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-71f40cef-e835-413c-b641-ee47880cd0e8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:45.752442 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-71f40cef-e835-413c-b641-ee47880cd0e8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:45.753447 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 219/447] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:45 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 1308 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:45.869473 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a2fd521a-f632-4ca4-b8c9-1d9947402d7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:45.870797 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-a2fd521a-f632-4ca4-b8c9-1d9947402d7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:45.883252 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a2fd521a-f632-4ca4-b8c9-1d9947402d7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:45.884017 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a2fd521a-f632-4ca4-b8c9-1d9947402d7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:45.885369 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a2fd521a-f632-4ca4-b8c9-1d9947402d7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:45.885861 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a2fd521a-f632-4ca4-b8c9-1d9947402d7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:45.912439 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-71f40cef-e835-413c-b641-ee47880cd0e8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:45.920632 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-71f40cef-e835-413c-b641-ee47880cd0e8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1722 microversion: 2.1 time: 0.182298 Jan 18 20:25:45.921222 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 229/448] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:45 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:46.079972 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a2fd521a-f632-4ca4-b8c9-1d9947402d7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:46.097394 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a2fd521a-f632-4ca4-b8c9-1d9947402d7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:46.101544 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a2fd521a-f632-4ca4-b8c9-1d9947402d7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:46.104100 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a2fd521a-f632-4ca4-b8c9-1d9947402d7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.239110 Jan 18 20:25:46.111155 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 220/449] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:45 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:25:46.352373 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-294b82e9-0c5f-4ed2-98ee-778f414e4c69 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:46.353006 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-294b82e9-0c5f-4ed2-98ee-778f414e4c69 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:46.359802 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-294b82e9-0c5f-4ed2-98ee-778f414e4c69 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:46.361023 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-294b82e9-0c5f-4ed2-98ee-778f414e4c69 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:46.361963 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-294b82e9-0c5f-4ed2-98ee-778f414e4c69 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:46.362396 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-294b82e9-0c5f-4ed2-98ee-778f414e4c69 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:46.524027 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-294b82e9-0c5f-4ed2-98ee-778f414e4c69 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:46.533049 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-294b82e9-0c5f-4ed2-98ee-778f414e4c69 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.184934 Jan 18 20:25:46.533640 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 230/450] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:46 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:46.770711 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-2adcaa7c-46da-4bbb-bcf4-24f770abbedc tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:46.771453 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-2adcaa7c-46da-4bbb-bcf4-24f770abbedc tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 58ea4f41-f0e8-4630-94ce-903130658ff4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:46.778241 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2adcaa7c-46da-4bbb-bcf4-24f770abbedc tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:46.778704 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2adcaa7c-46da-4bbb-bcf4-24f770abbedc tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:46.779680 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2adcaa7c-46da-4bbb-bcf4-24f770abbedc tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:46.780142 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2adcaa7c-46da-4bbb-bcf4-24f770abbedc tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:46.795108 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-2adcaa7c-46da-4bbb-bcf4-24f770abbedc tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] HTTP exception thrown: Instance 58ea4f41-f0e8-4630-94ce-903130658ff4 could not be found. Jan 18 20:25:46.795719 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-2adcaa7c-46da-4bbb-bcf4-24f770abbedc tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Returning 404 to user: Instance 58ea4f41-f0e8-4630-94ce-903130658ff4 could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:25:46.796602 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2adcaa7c-46da-4bbb-bcf4-24f770abbedc tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4" status: 404 len: 111 microversion: 2.1 time: 0.030348 Jan 18 20:25:46.797175 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 221/451] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:46 2022] GET /compute/v2.1/servers/58ea4f41-f0e8-4630-94ce-903130658ff4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:25:46.940408 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fedd054e-51e5-4c15-bf10-f79af3be9111 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:46.941244 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fedd054e-51e5-4c15-bf10-f79af3be9111 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:46.949116 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fedd054e-51e5-4c15-bf10-f79af3be9111 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:46.949542 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fedd054e-51e5-4c15-bf10-f79af3be9111 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:46.950638 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fedd054e-51e5-4c15-bf10-f79af3be9111 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:46.951272 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fedd054e-51e5-4c15-bf10-f79af3be9111 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:47.131593 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-6ffd5a16-0990-4f21-a6d2-23b9f538dc73 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:47.132359 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-6ffd5a16-0990-4f21-a6d2-23b9f538dc73 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:47.140440 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6ffd5a16-0990-4f21-a6d2-23b9f538dc73 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:47.141055 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6ffd5a16-0990-4f21-a6d2-23b9f538dc73 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:47.142869 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6ffd5a16-0990-4f21-a6d2-23b9f538dc73 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:47.144453 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6ffd5a16-0990-4f21-a6d2-23b9f538dc73 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:47.366684 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-6ffd5a16-0990-4f21-a6d2-23b9f538dc73 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:47.370308 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-6ffd5a16-0990-4f21-a6d2-23b9f538dc73 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:47.371868 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-6ffd5a16-0990-4f21-a6d2-23b9f538dc73 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:47.373057 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-6ffd5a16-0990-4f21-a6d2-23b9f538dc73 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1743 microversion: 2.20 time: 0.245916 Jan 18 20:25:47.373622 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 222/452] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:47 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1743 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:25:47.384505 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fedd054e-51e5-4c15-bf10-f79af3be9111 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:47.393786 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fedd054e-51e5-4c15-bf10-f79af3be9111 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1722 microversion: 2.1 time: 0.457487 Jan 18 20:25:47.394458 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 231/453] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:46 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1722 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:47.551802 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f6b36d03-9875-4e72-91c7-ad39066bc90a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:47.552607 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-f6b36d03-9875-4e72-91c7-ad39066bc90a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:47.559199 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f6b36d03-9875-4e72-91c7-ad39066bc90a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:47.559651 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f6b36d03-9875-4e72-91c7-ad39066bc90a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:47.561756 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f6b36d03-9875-4e72-91c7-ad39066bc90a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:47.561756 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f6b36d03-9875-4e72-91c7-ad39066bc90a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:47.737286 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-f6b36d03-9875-4e72-91c7-ad39066bc90a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:47.746508 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-f6b36d03-9875-4e72-91c7-ad39066bc90a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.199561 Jan 18 20:25:47.747148 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 223/454] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:47 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:47.952366 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f8d54e70-2e8d-4158-8883-d7b2cbe987ae tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:47.953118 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f8d54e70-2e8d-4158-8883-d7b2cbe987ae tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:47.960731 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f8d54e70-2e8d-4158-8883-d7b2cbe987ae tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:47.961276 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f8d54e70-2e8d-4158-8883-d7b2cbe987ae tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:47.962125 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f8d54e70-2e8d-4158-8883-d7b2cbe987ae tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:47.962641 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f8d54e70-2e8d-4158-8883-d7b2cbe987ae tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:47.991475 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f8d54e70-2e8d-4158-8883-d7b2cbe987ae tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:25:48.078174 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f8d54e70-2e8d-4158-8883-d7b2cbe987ae tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 204 len: 0 microversion: 2.1 time: 0.129014 Jan 18 20:25:48.079871 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 232/455] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:25:47 2022] DELETE /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:25:48.089918 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7c5b949c-31a5-4c9a-abb6-74eed1960e91 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:48.090827 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-7c5b949c-31a5-4c9a-abb6-74eed1960e91 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:48.099299 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7c5b949c-31a5-4c9a-abb6-74eed1960e91 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:48.099781 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7c5b949c-31a5-4c9a-abb6-74eed1960e91 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:48.100628 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7c5b949c-31a5-4c9a-abb6-74eed1960e91 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:48.101097 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7c5b949c-31a5-4c9a-abb6-74eed1960e91 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:48.255147 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-7c5b949c-31a5-4c9a-abb6-74eed1960e91 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:48.263873 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7c5b949c-31a5-4c9a-abb6-74eed1960e91 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 200 len: 1513 microversion: 2.1 time: 0.178019 Jan 18 20:25:48.264472 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 224/456] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:48 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:48.393876 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9b4bb816-9f84-48e4-98f6-bb51709b89f7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:48.394594 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9b4bb816-9f84-48e4-98f6-bb51709b89f7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:48.401214 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b4bb816-9f84-48e4-98f6-bb51709b89f7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:48.401660 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b4bb816-9f84-48e4-98f6-bb51709b89f7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:48.402470 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b4bb816-9f84-48e4-98f6-bb51709b89f7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:48.402909 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b4bb816-9f84-48e4-98f6-bb51709b89f7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:48.412464 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-9d4d40d0-102c-4a07-bcc4-ff33ab2d29ab tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:48.413325 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-9d4d40d0-102c-4a07-bcc4-ff33ab2d29ab tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:48.420133 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9d4d40d0-102c-4a07-bcc4-ff33ab2d29ab tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:48.420702 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9d4d40d0-102c-4a07-bcc4-ff33ab2d29ab tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:48.421496 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9d4d40d0-102c-4a07-bcc4-ff33ab2d29ab tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:48.421925 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9d4d40d0-102c-4a07-bcc4-ff33ab2d29ab tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:48.616538 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9b4bb816-9f84-48e4-98f6-bb51709b89f7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:48.623952 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-9d4d40d0-102c-4a07-bcc4-ff33ab2d29ab tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:48.625365 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9b4bb816-9f84-48e4-98f6-bb51709b89f7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:48.628632 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9b4bb816-9f84-48e4-98f6-bb51709b89f7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:48.630531 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9b4bb816-9f84-48e4-98f6-bb51709b89f7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1743 microversion: 2.20 time: 0.241921 Jan 18 20:25:48.631384 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 233/457] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:48 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1743 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:48.634038 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-9d4d40d0-102c-4a07-bcc4-ff33ab2d29ab tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1722 microversion: 2.1 time: 0.225163 Jan 18 20:25:48.634818 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 225/458] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:48 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:48.764830 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4b10755f-7953-4393-8ccc-abf9d600840c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:48.765372 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4b10755f-7953-4393-8ccc-abf9d600840c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:48.772325 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4b10755f-7953-4393-8ccc-abf9d600840c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:48.772792 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4b10755f-7953-4393-8ccc-abf9d600840c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:48.773709 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4b10755f-7953-4393-8ccc-abf9d600840c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:48.774350 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4b10755f-7953-4393-8ccc-abf9d600840c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:48.944767 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4b10755f-7953-4393-8ccc-abf9d600840c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:48.958445 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4b10755f-7953-4393-8ccc-abf9d600840c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.197536 Jan 18 20:25:48.959424 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 234/459] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:48 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:49.282137 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0580bf3c-4661-44ca-b1a2-3d345ef72589 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:49.282766 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0580bf3c-4661-44ca-b1a2-3d345ef72589 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:49.292375 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0580bf3c-4661-44ca-b1a2-3d345ef72589 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:49.293150 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0580bf3c-4661-44ca-b1a2-3d345ef72589 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:49.294662 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0580bf3c-4661-44ca-b1a2-3d345ef72589 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:49.295520 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0580bf3c-4661-44ca-b1a2-3d345ef72589 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:49.463270 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-0580bf3c-4661-44ca-b1a2-3d345ef72589 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:49.471578 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0580bf3c-4661-44ca-b1a2-3d345ef72589 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 200 len: 1513 microversion: 2.1 time: 0.193138 Jan 18 20:25:49.472464 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 226/460] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:49 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:49.657305 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-88b0b720-dc1f-43f4-a6c6-ebe960e4ebe1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:49.658943 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-88b0b720-dc1f-43f4-a6c6-ebe960e4ebe1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:49.665851 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-bed605f2-3ace-4c07-88b2-e6595e4bf249 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:49.666963 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-bed605f2-3ace-4c07-88b2-e6595e4bf249 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:49.669899 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-88b0b720-dc1f-43f4-a6c6-ebe960e4ebe1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:49.670683 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-88b0b720-dc1f-43f4-a6c6-ebe960e4ebe1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:49.672454 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-88b0b720-dc1f-43f4-a6c6-ebe960e4ebe1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:49.673579 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-88b0b720-dc1f-43f4-a6c6-ebe960e4ebe1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:49.686670 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bed605f2-3ace-4c07-88b2-e6595e4bf249 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:49.687439 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bed605f2-3ace-4c07-88b2-e6595e4bf249 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:49.688837 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bed605f2-3ace-4c07-88b2-e6595e4bf249 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:49.689583 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bed605f2-3ace-4c07-88b2-e6595e4bf249 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:49.878737 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-bed605f2-3ace-4c07-88b2-e6595e4bf249 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:49.891991 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-bed605f2-3ace-4c07-88b2-e6595e4bf249 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:49.892542 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-bed605f2-3ace-4c07-88b2-e6595e4bf249 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:49.893624 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-bed605f2-3ace-4c07-88b2-e6595e4bf249 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1743 microversion: 2.20 time: 0.233980 Jan 18 20:25:49.894517 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 227/461] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:49 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1743 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:49.897081 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-88b0b720-dc1f-43f4-a6c6-ebe960e4ebe1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:49.906222 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-88b0b720-dc1f-43f4-a6c6-ebe960e4ebe1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1722 microversion: 2.1 time: 0.256993 Jan 18 20:25:49.917622 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 235/462] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:49 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:49.976027 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f602edf6-97a7-4a07-ae64-d535c15c4712 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:49.976640 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-f602edf6-97a7-4a07-ae64-d535c15c4712 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:49.983523 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f602edf6-97a7-4a07-ae64-d535c15c4712 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:49.984179 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f602edf6-97a7-4a07-ae64-d535c15c4712 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:49.985268 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f602edf6-97a7-4a07-ae64-d535c15c4712 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:49.985823 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f602edf6-97a7-4a07-ae64-d535c15c4712 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:50.184225 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-f602edf6-97a7-4a07-ae64-d535c15c4712 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:50.199454 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-f602edf6-97a7-4a07-ae64-d535c15c4712 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.226933 Jan 18 20:25:50.208665 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 228/463] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:49 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:50.493499 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0b9be84c-5b03-4505-89f7-665258aa592f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:50.495588 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0b9be84c-5b03-4505-89f7-665258aa592f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:50.508790 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0b9be84c-5b03-4505-89f7-665258aa592f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:50.510181 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0b9be84c-5b03-4505-89f7-665258aa592f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:50.512027 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0b9be84c-5b03-4505-89f7-665258aa592f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:50.513115 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0b9be84c-5b03-4505-89f7-665258aa592f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:50.829818 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0b9be84c-5b03-4505-89f7-665258aa592f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:50.844833 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0b9be84c-5b03-4505-89f7-665258aa592f tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 200 len: 1513 microversion: 2.1 time: 0.358516 Jan 18 20:25:50.854910 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 236/464] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:50 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 1513 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:50.935762 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-dd75c389-98df-466d-9743-a0e421221ae8 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:50.936988 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-dd75c389-98df-466d-9743-a0e421221ae8 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:50.942546 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-59868bbb-ff4f-43fd-83c7-48a09d7571f0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:50.944854 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-59868bbb-ff4f-43fd-83c7-48a09d7571f0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:50.966581 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-59868bbb-ff4f-43fd-83c7-48a09d7571f0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:50.967719 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd75c389-98df-466d-9743-a0e421221ae8 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:50.968883 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd75c389-98df-466d-9743-a0e421221ae8 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:50.972175 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-59868bbb-ff4f-43fd-83c7-48a09d7571f0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:50.974044 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-59868bbb-ff4f-43fd-83c7-48a09d7571f0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:50.974599 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd75c389-98df-466d-9743-a0e421221ae8 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:50.975852 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd75c389-98df-466d-9743-a0e421221ae8 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:50.977041 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-59868bbb-ff4f-43fd-83c7-48a09d7571f0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:51.388319 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-59868bbb-ff4f-43fd-83c7-48a09d7571f0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:51.400734 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-59868bbb-ff4f-43fd-83c7-48a09d7571f0 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1722 microversion: 2.1 time: 0.478634 Jan 18 20:25:51.406937 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 229/465] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:50 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1722 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:51.412521 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-db9b90d2-5f79-4a98-8dce-e588d847bfb2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:51.419161 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-db9b90d2-5f79-4a98-8dce-e588d847bfb2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:51.439260 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-dd75c389-98df-466d-9743-a0e421221ae8 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:51.449196 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-db9b90d2-5f79-4a98-8dce-e588d847bfb2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:51.450052 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-db9b90d2-5f79-4a98-8dce-e588d847bfb2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:51.450948 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-db9b90d2-5f79-4a98-8dce-e588d847bfb2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:51.451429 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-db9b90d2-5f79-4a98-8dce-e588d847bfb2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:51.463175 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-dd75c389-98df-466d-9743-a0e421221ae8 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:51.468276 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-dd75c389-98df-466d-9743-a0e421221ae8 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:51.472046 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-dd75c389-98df-466d-9743-a0e421221ae8 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1738 microversion: 2.20 time: 0.543051 Jan 18 20:25:51.474542 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 237/466] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:50 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1738 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:51.860255 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-db9b90d2-5f79-4a98-8dce-e588d847bfb2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:51.866031 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c328e6d0-e42a-422c-8603-e45654d169d1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:51.872571 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c328e6d0-e42a-422c-8603-e45654d169d1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:51.874380 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-db9b90d2-5f79-4a98-8dce-e588d847bfb2 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.465484 Jan 18 20:25:51.877063 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 230/467] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:51 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:51.887062 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c328e6d0-e42a-422c-8603-e45654d169d1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:51.891963 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c328e6d0-e42a-422c-8603-e45654d169d1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:51.893416 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c328e6d0-e42a-422c-8603-e45654d169d1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:51.894230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c328e6d0-e42a-422c-8603-e45654d169d1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:52.020184 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c328e6d0-e42a-422c-8603-e45654d169d1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:52.037557 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c328e6d0-e42a-422c-8603-e45654d169d1 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 200 len: 1471 microversion: 2.1 time: 0.178503 Jan 18 20:25:52.039593 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 238/468] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:51 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:52.143999 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-e54701d2-706e-4451-a2de-62c926a01430 req-0bb03f2c-9d09-4d02-8980-918c5ce41020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00", "name": "network-vif-deleted", "tag": "f2f1aac5-1110-4e24-863b-979ce59260f2"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:52.146626 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:25:52.146626 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:25:52.156024 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-e54701d2-706e-4451-a2de-62c926a01430 req-0bb03f2c-9d09-4d02-8980-918c5ce41020 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:52.158275 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-e54701d2-706e-4451-a2de-62c926a01430 req-0bb03f2c-9d09-4d02-8980-918c5ce41020 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:52.174285 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-e54701d2-706e-4451-a2de-62c926a01430 req-0bb03f2c-9d09-4d02-8980-918c5ce41020 service nova] Creating event network-vif-deleted:f2f1aac5-1110-4e24-863b-979ce59260f2 for instance f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 on hv-cinder-82160 Jan 18 20:25:52.187265 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-e54701d2-706e-4451-a2de-62c926a01430 req-0bb03f2c-9d09-4d02-8980-918c5ce41020 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052205 Jan 18 20:25:52.188170 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 231/469] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:25:52.443427 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2dc75df5-1958-4bab-9f96-86720a2ba770 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:52.445137 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2dc75df5-1958-4bab-9f96-86720a2ba770 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:52.465453 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2dc75df5-1958-4bab-9f96-86720a2ba770 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:52.466669 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2dc75df5-1958-4bab-9f96-86720a2ba770 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:52.468420 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2dc75df5-1958-4bab-9f96-86720a2ba770 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:52.470128 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2dc75df5-1958-4bab-9f96-86720a2ba770 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:52.508760 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-977c8353-fd83-482a-bf3e-c69de2b00cb6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:52.521617 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-977c8353-fd83-482a-bf3e-c69de2b00cb6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:52.552535 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-977c8353-fd83-482a-bf3e-c69de2b00cb6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:52.554000 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-977c8353-fd83-482a-bf3e-c69de2b00cb6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:52.556077 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-977c8353-fd83-482a-bf3e-c69de2b00cb6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:52.557306 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-977c8353-fd83-482a-bf3e-c69de2b00cb6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:52.787786 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2dc75df5-1958-4bab-9f96-86720a2ba770 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:52.829239 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2dc75df5-1958-4bab-9f96-86720a2ba770 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1722 microversion: 2.1 time: 0.391851 Jan 18 20:25:52.830769 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 239/470] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:52 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1722 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:52.841230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-a043db06-d2fc-44e0-9be6-0a49a5a39940 req-4b9a977b-dd8c-4c8b-aa42-3fed478790a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54f16911-8813-49b1-a940-9d83c6a5b131", "name": "network-vif-plugged", "status": "completed", "tag": "555e1e24-9775-40bc-b590-9ec8763d4dd0"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:52.849243 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:25:52.849243 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:25:52.888841 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-a043db06-d2fc-44e0-9be6-0a49a5a39940 req-4b9a977b-dd8c-4c8b-aa42-3fed478790a9 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:52.890086 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-a043db06-d2fc-44e0-9be6-0a49a5a39940 req-4b9a977b-dd8c-4c8b-aa42-3fed478790a9 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:52.941657 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-a043db06-d2fc-44e0-9be6-0a49a5a39940 req-4b9a977b-dd8c-4c8b-aa42-3fed478790a9 service nova] Creating event network-vif-plugged:555e1e24-9775-40bc-b590-9ec8763d4dd0 for instance 54f16911-8813-49b1-a940-9d83c6a5b131 on hv-cinder-82160 Jan 18 20:25:52.953261 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-a043db06-d2fc-44e0-9be6-0a49a5a39940 req-4b9a977b-dd8c-4c8b-aa42-3fed478790a9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120214 Jan 18 20:25:52.956213 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 240/471] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:25:52.968288 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6e5d3059-c8f6-4293-b616-5f8f8f280162 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:52.970254 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6e5d3059-c8f6-4293-b616-5f8f8f280162 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:52.998697 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6e5d3059-c8f6-4293-b616-5f8f8f280162 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:53.002751 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6e5d3059-c8f6-4293-b616-5f8f8f280162 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:53.004403 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6e5d3059-c8f6-4293-b616-5f8f8f280162 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:53.005154 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6e5d3059-c8f6-4293-b616-5f8f8f280162 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:53.029090 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-977c8353-fd83-482a-bf3e-c69de2b00cb6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:53.046193 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-977c8353-fd83-482a-bf3e-c69de2b00cb6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:53.058182 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-977c8353-fd83-482a-bf3e-c69de2b00cb6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:53.071334 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-977c8353-fd83-482a-bf3e-c69de2b00cb6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1738 microversion: 2.20 time: 0.570639 Jan 18 20:25:53.072370 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 232/472] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:52 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1738 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:53.085869 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0a970ca5-c8d4-43c2-9128-fb292999be19 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:53.090933 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0a970ca5-c8d4-43c2-9128-fb292999be19 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:53.106067 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0a970ca5-c8d4-43c2-9128-fb292999be19 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:53.112338 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0a970ca5-c8d4-43c2-9128-fb292999be19 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:53.116612 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0a970ca5-c8d4-43c2-9128-fb292999be19 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:53.117370 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0a970ca5-c8d4-43c2-9128-fb292999be19 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:53.155784 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-0a970ca5-c8d4-43c2-9128-fb292999be19 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] HTTP exception thrown: Instance f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 could not be found. Jan 18 20:25:53.156896 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0a970ca5-c8d4-43c2-9128-fb292999be19 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Returning 404 to user: Instance f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:25:53.158863 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0a970ca5-c8d4-43c2-9128-fb292999be19 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00" status: 404 len: 111 microversion: 2.1 time: 0.084519 Jan 18 20:25:53.159928 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 233/473] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:53 2022] GET /compute/v2.1/servers/f23b2bcd-5a7d-47bd-8eed-e5a6c2f68a00 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:25:53.174114 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ac7c363c-3e35-4ada-9c0f-b8837885839a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:53.176000 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ac7c363c-3e35-4ada-9c0f-b8837885839a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:53.188862 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ac7c363c-3e35-4ada-9c0f-b8837885839a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:53.190067 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ac7c363c-3e35-4ada-9c0f-b8837885839a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:53.191818 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ac7c363c-3e35-4ada-9c0f-b8837885839a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:53.192879 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ac7c363c-3e35-4ada-9c0f-b8837885839a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:53.259984 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ac7c363c-3e35-4ada-9c0f-b8837885839a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Going to try to terminate instance {{(pid=116376) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:25:53.342051 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6e5d3059-c8f6-4293-b616-5f8f8f280162 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:53.357352 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6e5d3059-c8f6-4293-b616-5f8f8f280162 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.398465 Jan 18 20:25:53.358794 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 241/474] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:52 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:53.444672 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ac7c363c-3e35-4ada-9c0f-b8837885839a tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 204 len: 0 microversion: 2.1 time: 0.278849 Jan 18 20:25:53.445925 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 234/475] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:25:53 2022] DELETE /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:25:53.454458 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b5f281be-f190-4bf7-b114-93f90ec5e840 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:53.455230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b5f281be-f190-4bf7-b114-93f90ec5e840 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:53.465894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b5f281be-f190-4bf7-b114-93f90ec5e840 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:53.465894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b5f281be-f190-4bf7-b114-93f90ec5e840 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:53.465894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b5f281be-f190-4bf7-b114-93f90ec5e840 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:53.465894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b5f281be-f190-4bf7-b114-93f90ec5e840 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:53.653911 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b5f281be-f190-4bf7-b114-93f90ec5e840 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:53.669094 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b5f281be-f190-4bf7-b114-93f90ec5e840 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1513 microversion: 2.1 time: 0.218298 Jan 18 20:25:53.670315 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 242/476] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:53 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1513 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:53.867227 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b8a00d3e-1a5b-4a9a-862a-facc5d685303 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:53.867941 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b8a00d3e-1a5b-4a9a-862a-facc5d685303 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:53.874709 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b8a00d3e-1a5b-4a9a-862a-facc5d685303 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:53.878816 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b8a00d3e-1a5b-4a9a-862a-facc5d685303 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:53.881432 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b8a00d3e-1a5b-4a9a-862a-facc5d685303 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:53.882279 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b8a00d3e-1a5b-4a9a-862a-facc5d685303 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:54.063224 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b8a00d3e-1a5b-4a9a-862a-facc5d685303 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:54.074570 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b8a00d3e-1a5b-4a9a-862a-facc5d685303 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1699 microversion: 2.1 time: 0.217944 Jan 18 20:25:54.076315 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 235/477] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:53 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1699 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:54.095760 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b123a83d-f895-4823-ae87-5ad6f80cc80f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:54.102507 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-365890ab-7c05-4e9c-be42-0585870ae917 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:54.103563 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-365890ab-7c05-4e9c-be42-0585870ae917 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:54.103677 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b123a83d-f895-4823-ae87-5ad6f80cc80f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:54.104138 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b123a83d-f895-4823-ae87-5ad6f80cc80f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:54.112143 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-365890ab-7c05-4e9c-be42-0585870ae917 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:54.113428 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-365890ab-7c05-4e9c-be42-0585870ae917 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:54.114549 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-365890ab-7c05-4e9c-be42-0585870ae917 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:54.115270 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-365890ab-7c05-4e9c-be42-0585870ae917 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:54.134248 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b123a83d-f895-4823-ae87-5ad6f80cc80f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Going to try to start instance {{(pid=116375) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 18 20:25:54.212384 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b123a83d-f895-4823-ae87-5ad6f80cc80f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 202 len: 0 microversion: 2.1 time: 0.123232 Jan 18 20:25:54.216346 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 243/478] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:25:54 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:25:54.238953 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-27068985-79fb-4d46-a350-33f10899bfe6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:54.242495 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-27068985-79fb-4d46-a350-33f10899bfe6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:54.269821 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-27068985-79fb-4d46-a350-33f10899bfe6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:54.270394 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-27068985-79fb-4d46-a350-33f10899bfe6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:54.272052 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-27068985-79fb-4d46-a350-33f10899bfe6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:54.272960 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-27068985-79fb-4d46-a350-33f10899bfe6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:54.298698 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-365890ab-7c05-4e9c-be42-0585870ae917 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:54.314198 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-365890ab-7c05-4e9c-be42-0585870ae917 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:54.318014 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-365890ab-7c05-4e9c-be42-0585870ae917 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:54.319653 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-365890ab-7c05-4e9c-be42-0585870ae917 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1738 microversion: 2.20 time: 0.221057 Jan 18 20:25:54.320895 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 236/479] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:54 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:54.378253 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-9042d234-8252-4bfb-b569-662fb6931ccd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:54.379265 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-9042d234-8252-4bfb-b569-662fb6931ccd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:54.388986 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9042d234-8252-4bfb-b569-662fb6931ccd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:54.389809 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9042d234-8252-4bfb-b569-662fb6931ccd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:54.390944 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9042d234-8252-4bfb-b569-662fb6931ccd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:54.392918 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9042d234-8252-4bfb-b569-662fb6931ccd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:54.567892 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-27068985-79fb-4d46-a350-33f10899bfe6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:54.587678 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-27068985-79fb-4d46-a350-33f10899bfe6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1708 microversion: 2.1 time: 0.369262 Jan 18 20:25:54.589188 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 244/480] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:54 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1708 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:54.695405 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9496a50a-bf7c-4ae4-b6ef-731c9663abb9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:54.696913 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9496a50a-bf7c-4ae4-b6ef-731c9663abb9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:54.714177 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-9042d234-8252-4bfb-b569-662fb6931ccd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:54.722898 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9496a50a-bf7c-4ae4-b6ef-731c9663abb9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:54.725969 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-9042d234-8252-4bfb-b569-662fb6931ccd tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.352455 Jan 18 20:25:54.733128 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9496a50a-bf7c-4ae4-b6ef-731c9663abb9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:54.736914 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 237/481] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:54 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:54.751630 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9496a50a-bf7c-4ae4-b6ef-731c9663abb9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:54.752586 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9496a50a-bf7c-4ae4-b6ef-731c9663abb9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:55.086299 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9496a50a-bf7c-4ae4-b6ef-731c9663abb9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:55.096258 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9496a50a-bf7c-4ae4-b6ef-731c9663abb9 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1513 microversion: 2.1 time: 0.410695 Jan 18 20:25:55.106634 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 245/482] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:54 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1513 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:55.357599 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-51cd8705-d0b5-4ce2-8b17-39ca9d3e3993 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:55.375701 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-51cd8705-d0b5-4ce2-8b17-39ca9d3e3993 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:55.404104 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-51cd8705-d0b5-4ce2-8b17-39ca9d3e3993 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:55.405322 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-51cd8705-d0b5-4ce2-8b17-39ca9d3e3993 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:55.414047 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-51cd8705-d0b5-4ce2-8b17-39ca9d3e3993 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:55.415297 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-51cd8705-d0b5-4ce2-8b17-39ca9d3e3993 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:55.606782 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-67dfcccd-bb9f-40e4-8485-a39de20b58ef tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:55.607464 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-67dfcccd-bb9f-40e4-8485-a39de20b58ef tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:55.632644 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67dfcccd-bb9f-40e4-8485-a39de20b58ef tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:55.633211 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67dfcccd-bb9f-40e4-8485-a39de20b58ef tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:55.635985 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67dfcccd-bb9f-40e4-8485-a39de20b58ef tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:55.636510 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67dfcccd-bb9f-40e4-8485-a39de20b58ef tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:55.654138 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-51cd8705-d0b5-4ce2-8b17-39ca9d3e3993 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:55.670123 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-51cd8705-d0b5-4ce2-8b17-39ca9d3e3993 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:55.673603 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-51cd8705-d0b5-4ce2-8b17-39ca9d3e3993 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:55.676559 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-51cd8705-d0b5-4ce2-8b17-39ca9d3e3993 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1738 microversion: 2.20 time: 0.325558 Jan 18 20:25:55.677862 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 238/483] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:55 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1738 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:55.746896 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f46a16cc-ce36-4404-8f66-10530524e1e5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:55.747734 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-f46a16cc-ce36-4404-8f66-10530524e1e5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:55.759623 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f46a16cc-ce36-4404-8f66-10530524e1e5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:55.762314 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f46a16cc-ce36-4404-8f66-10530524e1e5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:55.762314 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f46a16cc-ce36-4404-8f66-10530524e1e5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:55.763097 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f46a16cc-ce36-4404-8f66-10530524e1e5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:55.984930 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-f46a16cc-ce36-4404-8f66-10530524e1e5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:56.002806 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-f46a16cc-ce36-4404-8f66-10530524e1e5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.260987 Jan 18 20:25:56.012908 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 239/484] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:55 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:56.020728 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-67dfcccd-bb9f-40e4-8485-a39de20b58ef tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:56.045011 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-67dfcccd-bb9f-40e4-8485-a39de20b58ef tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1708 microversion: 2.1 time: 0.432233 Jan 18 20:25:56.050826 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 246/485] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:55 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1708 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:56.114278 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ea2efbaf-8109-4080-a29c-a2e85ba1762c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:56.115023 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ea2efbaf-8109-4080-a29c-a2e85ba1762c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:56.127552 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ea2efbaf-8109-4080-a29c-a2e85ba1762c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:56.128115 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ea2efbaf-8109-4080-a29c-a2e85ba1762c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:56.129074 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ea2efbaf-8109-4080-a29c-a2e85ba1762c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:56.129580 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ea2efbaf-8109-4080-a29c-a2e85ba1762c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:56.244383 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-ea2efbaf-8109-4080-a29c-a2e85ba1762c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:56.253781 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ea2efbaf-8109-4080-a29c-a2e85ba1762c tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 200 len: 1471 microversion: 2.1 time: 0.143216 Jan 18 20:25:56.263913 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 240/486] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:56 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 1471 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:56.348063 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-193faa7c-e273-4567-a170-80b6613d76cc req-c81c82d2-8fe7-490c-8f42-46f1290510ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7866fc9-233f-4a31-85ae-87b6b5cf9474", "name": "network-vif-deleted", "tag": "8e771083-6f01-41a0-aae7-67a33901263a"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:25:56.349758 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:25:56.349758 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:25:56.360225 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-193faa7c-e273-4567-a170-80b6613d76cc req-c81c82d2-8fe7-490c-8f42-46f1290510ba service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:56.361037 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-193faa7c-e273-4567-a170-80b6613d76cc req-c81c82d2-8fe7-490c-8f42-46f1290510ba service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:56.373833 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-193faa7c-e273-4567-a170-80b6613d76cc req-c81c82d2-8fe7-490c-8f42-46f1290510ba service nova] Creating event network-vif-deleted:8e771083-6f01-41a0-aae7-67a33901263a for instance c7866fc9-233f-4a31-85ae-87b6b5cf9474 on hv-cinder-82160 Jan 18 20:25:56.381265 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-193faa7c-e273-4567-a170-80b6613d76cc req-c81c82d2-8fe7-490c-8f42-46f1290510ba service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036724 Jan 18 20:25:56.383806 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 247/487] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:25:56.707747 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-43fa6e13-ecc3-4b63-8d05-1cdca46a45a0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:56.709117 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-43fa6e13-ecc3-4b63-8d05-1cdca46a45a0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:56.723065 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-43fa6e13-ecc3-4b63-8d05-1cdca46a45a0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:56.723932 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-43fa6e13-ecc3-4b63-8d05-1cdca46a45a0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:56.725107 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-43fa6e13-ecc3-4b63-8d05-1cdca46a45a0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:56.725997 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-43fa6e13-ecc3-4b63-8d05-1cdca46a45a0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:56.990236 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-43fa6e13-ecc3-4b63-8d05-1cdca46a45a0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:57.001514 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-43fa6e13-ecc3-4b63-8d05-1cdca46a45a0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:57.003121 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-43fa6e13-ecc3-4b63-8d05-1cdca46a45a0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:57.004567 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-43fa6e13-ecc3-4b63-8d05-1cdca46a45a0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1738 microversion: 2.20 time: 0.304854 Jan 18 20:25:57.005395 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 241/488] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:56 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1738 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:25:57.028764 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-084bb459-fd6e-47e0-9db1-35b15ba27a34 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:57.030567 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-084bb459-fd6e-47e0-9db1-35b15ba27a34 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:57.040754 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-084bb459-fd6e-47e0-9db1-35b15ba27a34 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:57.041734 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-084bb459-fd6e-47e0-9db1-35b15ba27a34 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:57.042824 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-084bb459-fd6e-47e0-9db1-35b15ba27a34 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:57.043968 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-084bb459-fd6e-47e0-9db1-35b15ba27a34 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:57.069584 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-3c2fc5b2-e183-4377-8714-07759dab0b0e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:57.072936 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-3c2fc5b2-e183-4377-8714-07759dab0b0e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:57.082313 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3c2fc5b2-e183-4377-8714-07759dab0b0e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:57.082900 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3c2fc5b2-e183-4377-8714-07759dab0b0e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:57.084320 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3c2fc5b2-e183-4377-8714-07759dab0b0e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:57.084944 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3c2fc5b2-e183-4377-8714-07759dab0b0e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:57.275736 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-084bb459-fd6e-47e0-9db1-35b15ba27a34 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:57.302182 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-084bb459-fd6e-47e0-9db1-35b15ba27a34 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.281101 Jan 18 20:25:57.304985 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 248/489] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:57 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:57.310664 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-eaa36f93-3a91-4a87-bc23-60c72c4deedf tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:57.311195 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-3c2fc5b2-e183-4377-8714-07759dab0b0e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:57.311779 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-eaa36f93-3a91-4a87-bc23-60c72c4deedf tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: c7866fc9-233f-4a31-85ae-87b6b5cf9474] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:57.318949 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eaa36f93-3a91-4a87-bc23-60c72c4deedf tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:57.319698 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eaa36f93-3a91-4a87-bc23-60c72c4deedf tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:57.320657 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eaa36f93-3a91-4a87-bc23-60c72c4deedf tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:57.321323 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-3c2fc5b2-e183-4377-8714-07759dab0b0e tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1712 microversion: 2.1 time: 0.259411 Jan 18 20:25:57.321894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eaa36f93-3a91-4a87-bc23-60c72c4deedf tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:57.322435 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 242/490] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:57 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1712 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:57.341286 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-eaa36f93-3a91-4a87-bc23-60c72c4deedf tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] HTTP exception thrown: Instance c7866fc9-233f-4a31-85ae-87b6b5cf9474 could not be found. Jan 18 20:25:57.342180 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-eaa36f93-3a91-4a87-bc23-60c72c4deedf tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Returning 404 to user: Instance c7866fc9-233f-4a31-85ae-87b6b5cf9474 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:25:57.343248 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-eaa36f93-3a91-4a87-bc23-60c72c4deedf tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474" status: 404 len: 111 microversion: 2.1 time: 0.036559 Jan 18 20:25:57.349903 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 249/491] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:57 2022] GET /compute/v2.1/servers/c7866fc9-233f-4a31-85ae-87b6b5cf9474 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:25:58.027226 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-769267ae-527e-44cb-8a80-3e7bfa1cc562 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:58.028528 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-769267ae-527e-44cb-8a80-3e7bfa1cc562 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:58.036044 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-769267ae-527e-44cb-8a80-3e7bfa1cc562 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:58.036489 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-769267ae-527e-44cb-8a80-3e7bfa1cc562 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:58.037308 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-769267ae-527e-44cb-8a80-3e7bfa1cc562 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:58.037755 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-769267ae-527e-44cb-8a80-3e7bfa1cc562 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:58.253196 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-769267ae-527e-44cb-8a80-3e7bfa1cc562 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:58.262113 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-769267ae-527e-44cb-8a80-3e7bfa1cc562 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:58.263987 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-769267ae-527e-44cb-8a80-3e7bfa1cc562 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:58.265360 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-769267ae-527e-44cb-8a80-3e7bfa1cc562 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1738 microversion: 2.20 time: 0.242050 Jan 18 20:25:58.265974 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 243/492] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:58 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:25:58.335634 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-535c1728-2b4e-42e8-a289-4c12767479e0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:58.336407 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-535c1728-2b4e-42e8-a289-4c12767479e0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:58.345729 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-535c1728-2b4e-42e8-a289-4c12767479e0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:58.346031 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-535c1728-2b4e-42e8-a289-4c12767479e0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:58.346742 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-535c1728-2b4e-42e8-a289-4c12767479e0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:58.347278 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-535c1728-2b4e-42e8-a289-4c12767479e0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:58.552173 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-535c1728-2b4e-42e8-a289-4c12767479e0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:58.558043 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5f013986-0e1d-42f5-b31d-4403d83ea463 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:58.558695 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-5f013986-0e1d-42f5-b31d-4403d83ea463 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:58.561405 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-535c1728-2b4e-42e8-a289-4c12767479e0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.229646 Jan 18 20:25:58.561998 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 250/493] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:58 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:25:58.565878 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5f013986-0e1d-42f5-b31d-4403d83ea463 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:58.566304 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5f013986-0e1d-42f5-b31d-4403d83ea463 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:58.567520 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5f013986-0e1d-42f5-b31d-4403d83ea463 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:58.567749 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5f013986-0e1d-42f5-b31d-4403d83ea463 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:58.596327 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-5f013986-0e1d-42f5-b31d-4403d83ea463 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Going to try to terminate instance {{(pid=116376) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:25:58.722909 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-5f013986-0e1d-42f5-b31d-4403d83ea463 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "DELETE /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 204 len: 0 microversion: 2.1 time: 0.169966 Jan 18 20:25:58.724672 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 244/494] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:25:58 2022] DELETE /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:25:58.734468 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bb207934-37ba-4e33-a79f-cf285411b657 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:58.735396 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bb207934-37ba-4e33-a79f-cf285411b657 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:58.744876 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb207934-37ba-4e33-a79f-cf285411b657 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:58.745525 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb207934-37ba-4e33-a79f-cf285411b657 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:58.746935 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb207934-37ba-4e33-a79f-cf285411b657 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:58.747537 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb207934-37ba-4e33-a79f-cf285411b657 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:58.958770 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bb207934-37ba-4e33-a79f-cf285411b657 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:58.968283 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bb207934-37ba-4e33-a79f-cf285411b657 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1513 microversion: 2.1 time: 0.237892 Jan 18 20:25:58.968902 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 251/495] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:58 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:59.291705 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fc82f862-3e7a-44aa-815b-7a6f09ddd799 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:59.292556 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-fc82f862-3e7a-44aa-815b-7a6f09ddd799 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:59.301848 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fc82f862-3e7a-44aa-815b-7a6f09ddd799 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:59.302290 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fc82f862-3e7a-44aa-815b-7a6f09ddd799 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:59.303131 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fc82f862-3e7a-44aa-815b-7a6f09ddd799 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:59.303568 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fc82f862-3e7a-44aa-815b-7a6f09ddd799 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:59.499557 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-fc82f862-3e7a-44aa-815b-7a6f09ddd799 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:59.510600 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-fc82f862-3e7a-44aa-815b-7a6f09ddd799 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:59.512267 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-fc82f862-3e7a-44aa-815b-7a6f09ddd799 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:59.513850 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-fc82f862-3e7a-44aa-815b-7a6f09ddd799 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1738 microversion: 2.20 time: 0.226038 Jan 18 20:25:59.514939 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 245/496] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:25:59 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:25:59.583270 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9a56f3b1-5b9d-4c20-9976-7cc522efef14 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:59.586881 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9a56f3b1-5b9d-4c20-9976-7cc522efef14 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:59.599910 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9a56f3b1-5b9d-4c20-9976-7cc522efef14 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:59.601104 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9a56f3b1-5b9d-4c20-9976-7cc522efef14 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:59.602269 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9a56f3b1-5b9d-4c20-9976-7cc522efef14 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:59.603115 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9a56f3b1-5b9d-4c20-9976-7cc522efef14 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:59.873010 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9a56f3b1-5b9d-4c20-9976-7cc522efef14 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:25:59.890257 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9a56f3b1-5b9d-4c20-9976-7cc522efef14 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.314681 Jan 18 20:25:59.899428 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 252/497] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:59 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:25:59.985520 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e4cc8fb2-26e9-4904-ad97-c401d194fee8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:25:59.986318 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e4cc8fb2-26e9-4904-ad97-c401d194fee8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:25:59.993447 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e4cc8fb2-26e9-4904-ad97-c401d194fee8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:59.994128 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e4cc8fb2-26e9-4904-ad97-c401d194fee8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:25:59.994984 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e4cc8fb2-26e9-4904-ad97-c401d194fee8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:25:59.995516 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e4cc8fb2-26e9-4904-ad97-c401d194fee8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:00.159016 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-e4cc8fb2-26e9-4904-ad97-c401d194fee8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:00.167597 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e4cc8fb2-26e9-4904-ad97-c401d194fee8 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1513 microversion: 2.1 time: 0.185759 Jan 18 20:26:00.168168 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 246/498] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:25:59 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:00.553185 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a53fa346-6f04-4f9a-ac4d-8de9f9e8961b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:00.554515 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a53fa346-6f04-4f9a-ac4d-8de9f9e8961b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:00.566391 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a53fa346-6f04-4f9a-ac4d-8de9f9e8961b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:00.567501 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a53fa346-6f04-4f9a-ac4d-8de9f9e8961b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:00.568976 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a53fa346-6f04-4f9a-ac4d-8de9f9e8961b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:00.569820 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a53fa346-6f04-4f9a-ac4d-8de9f9e8961b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:00.936180 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ed700e84-c342-45f7-8612-429f551e149d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:00.937000 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ed700e84-c342-45f7-8612-429f551e149d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:00.966036 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ed700e84-c342-45f7-8612-429f551e149d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:00.967771 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ed700e84-c342-45f7-8612-429f551e149d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:00.969414 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ed700e84-c342-45f7-8612-429f551e149d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:00.969945 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ed700e84-c342-45f7-8612-429f551e149d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:01.017250 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a53fa346-6f04-4f9a-ac4d-8de9f9e8961b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:01.044541 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a53fa346-6f04-4f9a-ac4d-8de9f9e8961b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:01.049491 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a53fa346-6f04-4f9a-ac4d-8de9f9e8961b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:01.051892 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a53fa346-6f04-4f9a-ac4d-8de9f9e8961b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1738 microversion: 2.20 time: 0.505775 Jan 18 20:26:01.053515 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 253/499] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:00 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1738 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:01.191515 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b72a1a74-be24-4daa-a8a9-7c394149a588 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:01.199744 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b72a1a74-be24-4daa-a8a9-7c394149a588 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:01.222510 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b72a1a74-be24-4daa-a8a9-7c394149a588 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:01.223712 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b72a1a74-be24-4daa-a8a9-7c394149a588 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:01.226563 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b72a1a74-be24-4daa-a8a9-7c394149a588 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:01.229787 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b72a1a74-be24-4daa-a8a9-7c394149a588 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:01.326994 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-ed700e84-c342-45f7-8612-429f551e149d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:01.350023 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ed700e84-c342-45f7-8612-429f551e149d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.427353 Jan 18 20:26:01.350023 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 247/500] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:00 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:26:01.699309 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-6fc41f53-1f75-4c38-bfbe-0c43a81a2654 req-7d53957a-9990-44ba-a7c8-08430032a08c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46334d7f-6fa1-41ba-bc9d-a80684750c70", "name": "network-vif-deleted", "tag": "99714da3-e00f-44f4-9a6d-0775f70695dc"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:26:01.701049 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:26:01.701049 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:26:01.716314 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-6fc41f53-1f75-4c38-bfbe-0c43a81a2654 req-7d53957a-9990-44ba-a7c8-08430032a08c service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:01.716758 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-6fc41f53-1f75-4c38-bfbe-0c43a81a2654 req-7d53957a-9990-44ba-a7c8-08430032a08c service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:01.738503 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-6fc41f53-1f75-4c38-bfbe-0c43a81a2654 req-7d53957a-9990-44ba-a7c8-08430032a08c service nova] Creating event network-vif-deleted:99714da3-e00f-44f4-9a6d-0775f70695dc for instance 46334d7f-6fa1-41ba-bc9d-a80684750c70 on hv-cinder-82160 Jan 18 20:26:01.753589 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-6fc41f53-1f75-4c38-bfbe-0c43a81a2654 req-7d53957a-9990-44ba-a7c8-08430032a08c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057783 Jan 18 20:26:01.754441 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 248/501] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:26:01.787080 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b72a1a74-be24-4daa-a8a9-7c394149a588 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8a95c08cbe4253b4c279403eeb2bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d65640ff94651a7ef1d826ade4cfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:01.796619 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b72a1a74-be24-4daa-a8a9-7c394149a588 tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 200 len: 1513 microversion: 2.1 time: 0.611532 Jan 18 20:26:01.798188 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 254/502] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:01 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 1513 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:02.080276 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d27cacf1-125a-45d6-ba7a-c9bfdd9adad5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:02.082541 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d27cacf1-125a-45d6-ba7a-c9bfdd9adad5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:02.095982 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d27cacf1-125a-45d6-ba7a-c9bfdd9adad5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:02.097164 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d27cacf1-125a-45d6-ba7a-c9bfdd9adad5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:02.099189 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d27cacf1-125a-45d6-ba7a-c9bfdd9adad5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:02.100401 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d27cacf1-125a-45d6-ba7a-c9bfdd9adad5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:02.375663 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9ef68963-a45c-4e0c-a3c6-66feca77bb50 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:02.381347 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9ef68963-a45c-4e0c-a3c6-66feca77bb50 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:02.398893 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9ef68963-a45c-4e0c-a3c6-66feca77bb50 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:02.399757 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9ef68963-a45c-4e0c-a3c6-66feca77bb50 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:02.404714 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9ef68963-a45c-4e0c-a3c6-66feca77bb50 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:02.405864 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9ef68963-a45c-4e0c-a3c6-66feca77bb50 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:02.589326 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d27cacf1-125a-45d6-ba7a-c9bfdd9adad5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:02.624794 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d27cacf1-125a-45d6-ba7a-c9bfdd9adad5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:02.634045 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d27cacf1-125a-45d6-ba7a-c9bfdd9adad5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:02.641612 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d27cacf1-125a-45d6-ba7a-c9bfdd9adad5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1738 microversion: 2.20 time: 0.567090 Jan 18 20:26:02.655069 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 249/503] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:02 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1738 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:02.743303 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9ef68963-a45c-4e0c-a3c6-66feca77bb50 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:02.760842 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9ef68963-a45c-4e0c-a3c6-66feca77bb50 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.393135 Jan 18 20:26:02.762620 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 255/504] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:02 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:26:02.820493 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b0f4b7a1-84b5-4248-b9a7-0b32e3aab4fe tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:02.821708 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b0f4b7a1-84b5-4248-b9a7-0b32e3aab4fe tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] [instance: 46334d7f-6fa1-41ba-bc9d-a80684750c70] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:02.831328 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b0f4b7a1-84b5-4248-b9a7-0b32e3aab4fe tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:02.832176 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b0f4b7a1-84b5-4248-b9a7-0b32e3aab4fe tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:02.833686 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b0f4b7a1-84b5-4248-b9a7-0b32e3aab4fe tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:02.834475 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b0f4b7a1-84b5-4248-b9a7-0b32e3aab4fe tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:02.850429 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-b0f4b7a1-84b5-4248-b9a7-0b32e3aab4fe tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] HTTP exception thrown: Instance 46334d7f-6fa1-41ba-bc9d-a80684750c70 could not be found. Jan 18 20:26:02.851053 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b0f4b7a1-84b5-4248-b9a7-0b32e3aab4fe tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] Returning 404 to user: Instance 46334d7f-6fa1-41ba-bc9d-a80684750c70 could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:26:02.851926 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b0f4b7a1-84b5-4248-b9a7-0b32e3aab4fe tempest-AttachVolumeNegativeTest-43109402 tempest-AttachVolumeNegativeTest-43109402-project] 10.222.0.67 "GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70" status: 404 len: 111 microversion: 2.1 time: 0.038238 Jan 18 20:26:02.856430 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 250/505] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:02 2022] GET /compute/v2.1/servers/46334d7f-6fa1-41ba-bc9d-a80684750c70 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:26:03.670733 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5e039a55-8739-4082-9edb-a3e31f805576 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:03.672585 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5e039a55-8739-4082-9edb-a3e31f805576 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:03.686123 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5e039a55-8739-4082-9edb-a3e31f805576 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:03.689877 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5e039a55-8739-4082-9edb-a3e31f805576 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:03.691670 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5e039a55-8739-4082-9edb-a3e31f805576 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:03.699464 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5e039a55-8739-4082-9edb-a3e31f805576 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:03.786064 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d93dc559-9788-49d2-9041-209a3296e8f5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:03.787177 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d93dc559-9788-49d2-9041-209a3296e8f5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:03.796970 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d93dc559-9788-49d2-9041-209a3296e8f5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:03.797434 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d93dc559-9788-49d2-9041-209a3296e8f5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:03.798270 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d93dc559-9788-49d2-9041-209a3296e8f5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:03.799727 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d93dc559-9788-49d2-9041-209a3296e8f5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:03.980175 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5e039a55-8739-4082-9edb-a3e31f805576 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:04.020688 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5e039a55-8739-4082-9edb-a3e31f805576 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:04.022314 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5e039a55-8739-4082-9edb-a3e31f805576 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:04.023574 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5e039a55-8739-4082-9edb-a3e31f805576 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1720 microversion: 2.20 time: 0.357352 Jan 18 20:26:04.040289 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 256/506] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:03 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1720 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:04.081254 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d93dc559-9788-49d2-9041-209a3296e8f5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:04.095962 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d93dc559-9788-49d2-9041-209a3296e8f5 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1567 microversion: 2.1 time: 0.318935 Jan 18 20:26:04.096967 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 251/507] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:03 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1567 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:26:05.057886 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6eda6fc5-9661-4fab-9b30-d4deb1b0a06b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:05.058626 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6eda6fc5-9661-4fab-9b30-d4deb1b0a06b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:05.065746 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6eda6fc5-9661-4fab-9b30-d4deb1b0a06b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:05.066192 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6eda6fc5-9661-4fab-9b30-d4deb1b0a06b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:05.066985 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6eda6fc5-9661-4fab-9b30-d4deb1b0a06b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:05.067481 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6eda6fc5-9661-4fab-9b30-d4deb1b0a06b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:05.127478 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-dbe48ed6-0a8c-462d-8db6-fb87b6a3e7c4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:05.128081 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-dbe48ed6-0a8c-462d-8db6-fb87b6a3e7c4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:05.135002 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dbe48ed6-0a8c-462d-8db6-fb87b6a3e7c4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:05.135763 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dbe48ed6-0a8c-462d-8db6-fb87b6a3e7c4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:05.136569 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dbe48ed6-0a8c-462d-8db6-fb87b6a3e7c4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:05.137008 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dbe48ed6-0a8c-462d-8db6-fb87b6a3e7c4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:05.253167 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6eda6fc5-9661-4fab-9b30-d4deb1b0a06b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:05.264879 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6eda6fc5-9661-4fab-9b30-d4deb1b0a06b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:05.267346 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6eda6fc5-9661-4fab-9b30-d4deb1b0a06b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:05.268460 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6eda6fc5-9661-4fab-9b30-d4deb1b0a06b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1720 microversion: 2.20 time: 0.214476 Jan 18 20:26:05.269227 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 257/508] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:05 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:26:05.352400 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-dbe48ed6-0a8c-462d-8db6-fb87b6a3e7c4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:05.360901 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-dbe48ed6-0a8c-462d-8db6-fb87b6a3e7c4 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1547 microversion: 2.1 time: 0.248304 Jan 18 20:26:05.361486 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 252/509] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:05 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1547 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:26:05.388021 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a74a4a30-865f-49ef-9845-df21c07eeec0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:05.388740 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a74a4a30-865f-49ef-9845-df21c07eeec0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:05.400899 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a74a4a30-865f-49ef-9845-df21c07eeec0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:05.401603 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a74a4a30-865f-49ef-9845-df21c07eeec0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:05.402945 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a74a4a30-865f-49ef-9845-df21c07eeec0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:05.403765 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a74a4a30-865f-49ef-9845-df21c07eeec0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:05.523335 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-a74a4a30-865f-49ef-9845-df21c07eeec0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] HTTP exception thrown: Cannot 'detach_volume' instance 712e0492-0709-4ab3-a1e2-5999b562d3fc while it is in vm_state rescued Jan 18 20:26:05.523931 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a74a4a30-865f-49ef-9845-df21c07eeec0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Returning 409 to user: Cannot 'detach_volume' instance 712e0492-0709-4ab3-a1e2-5999b562d3fc while it is in vm_state rescued {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:26:05.524767 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a74a4a30-865f-49ef-9845-df21c07eeec0 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "DELETE /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/os-volume_attachments/616acd30-dfe5-4fde-92fc-3653f24dff86" status: 409 len: 152 microversion: 2.1 time: 0.141462 Jan 18 20:26:05.525777 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 258/510] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Jan 18 20:26:05 2022] DELETE /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/os-volume_attachments/616acd30-dfe5-4fde-92fc-3653f24dff86 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 18 20:26:05.534849 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e4be9a4d-8c3c-4e09-a6d3-3c386469bc4a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:26:05.535598 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e4be9a4d-8c3c-4e09-a6d3-3c386469bc4a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:05.543334 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e4be9a4d-8c3c-4e09-a6d3-3c386469bc4a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:05.543981 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e4be9a4d-8c3c-4e09-a6d3-3c386469bc4a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:05.545091 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e4be9a4d-8c3c-4e09-a6d3-3c386469bc4a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:05.545599 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e4be9a4d-8c3c-4e09-a6d3-3c386469bc4a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:05.623086 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e4be9a4d-8c3c-4e09-a6d3-3c386469bc4a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "POST /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/action" status: 202 len: 0 microversion: 2.1 time: 0.092296 Jan 18 20:26:05.627584 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 253/511] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:26:05 2022] POST /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:26:05.635011 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-36781374-fc6c-49cf-bdfd-58759d61f39d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:05.635787 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-36781374-fc6c-49cf-bdfd-58759d61f39d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:05.643596 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-36781374-fc6c-49cf-bdfd-58759d61f39d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:05.644048 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-36781374-fc6c-49cf-bdfd-58759d61f39d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:05.644818 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-36781374-fc6c-49cf-bdfd-58759d61f39d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:05.645243 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-36781374-fc6c-49cf-bdfd-58759d61f39d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:05.906135 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-36781374-fc6c-49cf-bdfd-58759d61f39d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:05.923460 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-36781374-fc6c-49cf-bdfd-58759d61f39d tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1555 microversion: 2.1 time: 0.291829 Jan 18 20:26:05.924654 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 259/512] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:05 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1555 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:06.289498 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5c30a3fb-6d6b-4545-a251-4477b1925a52 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:06.290216 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-5c30a3fb-6d6b-4545-a251-4477b1925a52 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:06.297522 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5c30a3fb-6d6b-4545-a251-4477b1925a52 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:06.298005 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5c30a3fb-6d6b-4545-a251-4477b1925a52 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:06.299105 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5c30a3fb-6d6b-4545-a251-4477b1925a52 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:06.299558 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5c30a3fb-6d6b-4545-a251-4477b1925a52 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:06.458109 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-5c30a3fb-6d6b-4545-a251-4477b1925a52 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:06.466347 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-5c30a3fb-6d6b-4545-a251-4477b1925a52 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:06.467916 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-5c30a3fb-6d6b-4545-a251-4477b1925a52 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:06.469618 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-5c30a3fb-6d6b-4545-a251-4477b1925a52 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1723 microversion: 2.20 time: 0.185032 Jan 18 20:26:06.470176 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 254/513] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:06 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:06.488366 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-241f5252-bfdb-469d-85a4-3dcf03ac22fc tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d1e23cd-216f-4ae9-91d4-125828b02036"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:26:06.489514 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-241f5252-bfdb-469d-85a4-3dcf03ac22fc tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:06.498311 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-241f5252-bfdb-469d-85a4-3dcf03ac22fc tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:06.499210 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-241f5252-bfdb-469d-85a4-3dcf03ac22fc tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:06.500303 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-241f5252-bfdb-469d-85a4-3dcf03ac22fc tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:06.500909 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-241f5252-bfdb-469d-85a4-3dcf03ac22fc tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:06.777553 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-241f5252-bfdb-469d-85a4-3dcf03ac22fc tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.293648 Jan 18 20:26:06.778167 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 260/514] 10.222.0.67 () {62 vars in 1363 bytes} [Tue Jan 18 20:26:06 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/os-volume_attachments => generated 188 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:26:06.901868 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-09c55c38-3966-4161-a6d4-745cb9102c7f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:26:06.902438 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-09c55c38-3966-4161-a6d4-745cb9102c7f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:06.909201 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-09c55c38-3966-4161-a6d4-745cb9102c7f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:06.909648 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-09c55c38-3966-4161-a6d4-745cb9102c7f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:06.910445 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-09c55c38-3966-4161-a6d4-745cb9102c7f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:06.910878 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-09c55c38-3966-4161-a6d4-745cb9102c7f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:06.947874 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0f705aea-6267-4b6d-9ad9-7b835ee2ebf7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:06.948796 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0f705aea-6267-4b6d-9ad9-7b835ee2ebf7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:06.956142 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0f705aea-6267-4b6d-9ad9-7b835ee2ebf7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:06.956588 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0f705aea-6267-4b6d-9ad9-7b835ee2ebf7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:06.957390 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0f705aea-6267-4b6d-9ad9-7b835ee2ebf7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:06.957826 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0f705aea-6267-4b6d-9ad9-7b835ee2ebf7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:07.013353 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: ERROR oslo.messaging._drivers.impl_rabbit [None req-09c55c38-3966-4161-a6d4-745cb9102c7f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [ae537a66-edae-4c54-92cc-d218c41a3339] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 18 20:26:07.105242 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0f705aea-6267-4b6d-9ad9-7b835ee2ebf7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:07.120713 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0f705aea-6267-4b6d-9ad9-7b835ee2ebf7 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1555 microversion: 2.1 time: 0.176977 Jan 18 20:26:07.121295 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 261/515] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:06 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:26:08.021170 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO oslo.messaging._drivers.impl_rabbit [None req-09c55c38-3966-4161-a6d4-745cb9102c7f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [ae537a66-edae-4c54-92cc-d218c41a3339] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 38156. Jan 18 20:26:08.024504 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-09c55c38-3966-4161-a6d4-745cb9102c7f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action" status: 202 len: 0 microversion: 2.20 time: 1.126391 Jan 18 20:26:08.025125 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 255/516] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:26:06 2022] POST /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/action => generated 0 bytes in 1128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:26:08.033608 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5e94920d-2bb0-4d62-a2cf-94767213962e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:08.034887 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5e94920d-2bb0-4d62-a2cf-94767213962e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:08.041428 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5e94920d-2bb0-4d62-a2cf-94767213962e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:08.041872 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5e94920d-2bb0-4d62-a2cf-94767213962e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:08.042686 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5e94920d-2bb0-4d62-a2cf-94767213962e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:08.043221 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5e94920d-2bb0-4d62-a2cf-94767213962e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:08.146537 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-04446bb1-ef98-4d00-8621-d745bb1fb04e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:08.147635 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-04446bb1-ef98-4d00-8621-d745bb1fb04e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:08.163352 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-04446bb1-ef98-4d00-8621-d745bb1fb04e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:08.164107 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-04446bb1-ef98-4d00-8621-d745bb1fb04e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:08.165129 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-04446bb1-ef98-4d00-8621-d745bb1fb04e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:08.165569 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-04446bb1-ef98-4d00-8621-d745bb1fb04e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:08.219917 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5e94920d-2bb0-4d62-a2cf-94767213962e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:08.228792 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5e94920d-2bb0-4d62-a2cf-94767213962e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:08.230470 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5e94920d-2bb0-4d62-a2cf-94767213962e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:08.231885 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5e94920d-2bb0-4d62-a2cf-94767213962e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1749 microversion: 2.20 time: 0.202579 Jan 18 20:26:08.243550 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 262/517] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:08 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1749 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:08.310756 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-04446bb1-ef98-4d00-8621-d745bb1fb04e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:08.318850 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-04446bb1-ef98-4d00-8621-d745bb1fb04e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1561 microversion: 2.1 time: 0.183547 Jan 18 20:26:08.320065 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 256/518] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:08 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:26:08.419818 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2b7253a8-0c3f-4210-8a2a-f2cc642731de tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:08.420657 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2b7253a8-0c3f-4210-8a2a-f2cc642731de tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:08.429867 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b7253a8-0c3f-4210-8a2a-f2cc642731de tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:08.430628 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b7253a8-0c3f-4210-8a2a-f2cc642731de tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:08.431979 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b7253a8-0c3f-4210-8a2a-f2cc642731de tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:08.432747 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b7253a8-0c3f-4210-8a2a-f2cc642731de tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:08.531776 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-0585af45-3aef-4f4b-8ef3-e722059b40ac req-5e0037a1-89c9-4ac8-aea8-d12f97cdfcd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54f16911-8813-49b1-a940-9d83c6a5b131", "name": "network-vif-unplugged", "status": "completed", "tag": "555e1e24-9775-40bc-b590-9ec8763d4dd0"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:26:08.537556 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:26:08.537556 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:26:08.565085 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-0585af45-3aef-4f4b-8ef3-e722059b40ac req-5e0037a1-89c9-4ac8-aea8-d12f97cdfcd3 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:08.566056 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-0585af45-3aef-4f4b-8ef3-e722059b40ac req-5e0037a1-89c9-4ac8-aea8-d12f97cdfcd3 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:08.592021 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.compute.server_external_events [req-0585af45-3aef-4f4b-8ef3-e722059b40ac req-5e0037a1-89c9-4ac8-aea8-d12f97cdfcd3 service nova] Unable to find a host for instance 54f16911-8813-49b1-a940-9d83c6a5b131. Dropping event network-vif-unplugged {{(pid=116376) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 18 20:26:08.593969 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-0585af45-3aef-4f4b-8ef3-e722059b40ac req-5e0037a1-89c9-4ac8-aea8-d12f97cdfcd3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.069200 Jan 18 20:26:08.595791 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 257/519] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 18 20:26:08.621180 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-2b7253a8-0c3f-4210-8a2a-f2cc642731de tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lazy-loading 'services' on Instance uuid 712e0492-0709-4ab3-a1e2-5999b562d3fc {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:26:08.710207 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2b7253a8-0c3f-4210-8a2a-f2cc642731de tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "DELETE /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/os-volume_attachments/616acd30-dfe5-4fde-92fc-3653f24dff86" status: 202 len: 0 microversion: 2.1 time: 0.296728 Jan 18 20:26:08.710864 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 263/520] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Jan 18 20:26:08 2022] DELETE /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/os-volume_attachments/616acd30-dfe5-4fde-92fc-3653f24dff86 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:26:08.723106 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b8dafe8d-9e0a-490d-8782-072983192085 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:08.725273 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b8dafe8d-9e0a-490d-8782-072983192085 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:08.738978 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b8dafe8d-9e0a-490d-8782-072983192085 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:08.739564 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b8dafe8d-9e0a-490d-8782-072983192085 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:08.740374 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b8dafe8d-9e0a-490d-8782-072983192085 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:08.740875 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b8dafe8d-9e0a-490d-8782-072983192085 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:08.795555 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b8dafe8d-9e0a-490d-8782-072983192085 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079062 Jan 18 20:26:08.796284 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 258/521] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:26:08 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:26:09.254184 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-94d2ea4d-b628-48ce-88e1-375c35ceea2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:09.255266 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-94d2ea4d-b628-48ce-88e1-375c35ceea2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:09.262272 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94d2ea4d-b628-48ce-88e1-375c35ceea2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:09.262714 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94d2ea4d-b628-48ce-88e1-375c35ceea2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:09.263590 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94d2ea4d-b628-48ce-88e1-375c35ceea2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:09.264018 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94d2ea4d-b628-48ce-88e1-375c35ceea2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:09.497819 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-94d2ea4d-b628-48ce-88e1-375c35ceea2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:09.508186 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-94d2ea4d-b628-48ce-88e1-375c35ceea2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:09.509644 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-94d2ea4d-b628-48ce-88e1-375c35ceea2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:09.510989 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-94d2ea4d-b628-48ce-88e1-375c35ceea2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1751 microversion: 2.20 time: 0.262170 Jan 18 20:26:09.511731 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 264/522] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:09 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1751 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:09.811243 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0d4aa92a-4cb3-4ed3-9fba-fc3b8e87cd56 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:09.813977 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0d4aa92a-4cb3-4ed3-9fba-fc3b8e87cd56 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:09.825000 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0d4aa92a-4cb3-4ed3-9fba-fc3b8e87cd56 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:09.825510 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0d4aa92a-4cb3-4ed3-9fba-fc3b8e87cd56 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:09.826421 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0d4aa92a-4cb3-4ed3-9fba-fc3b8e87cd56 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:09.826897 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0d4aa92a-4cb3-4ed3-9fba-fc3b8e87cd56 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:09.859457 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0d4aa92a-4cb3-4ed3-9fba-fc3b8e87cd56 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051330 Jan 18 20:26:09.860173 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 259/523] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:26:09 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:26:10.539657 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-57281f96-e679-4cb3-8e1e-07f609621360 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:10.540376 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-57281f96-e679-4cb3-8e1e-07f609621360 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:10.547572 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-57281f96-e679-4cb3-8e1e-07f609621360 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:10.548391 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-57281f96-e679-4cb3-8e1e-07f609621360 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:10.549549 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-57281f96-e679-4cb3-8e1e-07f609621360 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:10.550052 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-57281f96-e679-4cb3-8e1e-07f609621360 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:10.782253 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-57281f96-e679-4cb3-8e1e-07f609621360 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:10.791487 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-57281f96-e679-4cb3-8e1e-07f609621360 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:10.794399 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-57281f96-e679-4cb3-8e1e-07f609621360 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:10.794399 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-57281f96-e679-4cb3-8e1e-07f609621360 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.258730 Jan 18 20:26:10.799678 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 265/524] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:10 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:11.814758 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-989a9dc7-d4a5-43b4-85ed-fb4d55ad822d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:11.816083 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-989a9dc7-d4a5-43b4-85ed-fb4d55ad822d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:11.834675 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-989a9dc7-d4a5-43b4-85ed-fb4d55ad822d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:11.835431 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-989a9dc7-d4a5-43b4-85ed-fb4d55ad822d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:11.836438 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-989a9dc7-d4a5-43b4-85ed-fb4d55ad822d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:11.837051 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-989a9dc7-d4a5-43b4-85ed-fb4d55ad822d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:12.083897 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-989a9dc7-d4a5-43b4-85ed-fb4d55ad822d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:12.102591 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-989a9dc7-d4a5-43b4-85ed-fb4d55ad822d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:12.108208 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-989a9dc7-d4a5-43b4-85ed-fb4d55ad822d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:12.109988 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-989a9dc7-d4a5-43b4-85ed-fb4d55ad822d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.300179 Jan 18 20:26:12.110560 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 260/525] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:11 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:12.268720 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a57e5b68-3e09-4c1b-89f7-498a9ed9e68c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:12.269614 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a57e5b68-3e09-4c1b-89f7-498a9ed9e68c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:12.281668 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a57e5b68-3e09-4c1b-89f7-498a9ed9e68c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:12.282211 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a57e5b68-3e09-4c1b-89f7-498a9ed9e68c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:12.283140 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a57e5b68-3e09-4c1b-89f7-498a9ed9e68c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:12.284111 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a57e5b68-3e09-4c1b-89f7-498a9ed9e68c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:12.314932 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a57e5b68-3e09-4c1b-89f7-498a9ed9e68c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:26:12.407384 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a57e5b68-3e09-4c1b-89f7-498a9ed9e68c tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "DELETE /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 204 len: 0 microversion: 2.1 time: 0.140987 Jan 18 20:26:12.408586 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 266/526] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:26:12 2022] DELETE /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:26:12.423241 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-63ba39b4-be42-44c0-a495-caf7fa21b620 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:12.424543 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-63ba39b4-be42-44c0-a495-caf7fa21b620 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:12.435155 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-63ba39b4-be42-44c0-a495-caf7fa21b620 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:12.435973 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-63ba39b4-be42-44c0-a495-caf7fa21b620 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:12.437780 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-63ba39b4-be42-44c0-a495-caf7fa21b620 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:12.438767 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-63ba39b4-be42-44c0-a495-caf7fa21b620 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:12.646972 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-63ba39b4-be42-44c0-a495-caf7fa21b620 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:12.662016 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-63ba39b4-be42-44c0-a495-caf7fa21b620 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1507 microversion: 2.1 time: 0.246695 Jan 18 20:26:12.680199 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 261/527] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:12 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1507 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:13.154612 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-caa40185-c3bc-4570-b5df-2d5a96bbbf65 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:13.157469 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-caa40185-c3bc-4570-b5df-2d5a96bbbf65 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:13.172298 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-caa40185-c3bc-4570-b5df-2d5a96bbbf65 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:13.173198 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-caa40185-c3bc-4570-b5df-2d5a96bbbf65 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:13.175010 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-caa40185-c3bc-4570-b5df-2d5a96bbbf65 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:13.175804 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-caa40185-c3bc-4570-b5df-2d5a96bbbf65 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:13.633761 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-caa40185-c3bc-4570-b5df-2d5a96bbbf65 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:13.644823 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-caa40185-c3bc-4570-b5df-2d5a96bbbf65 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:13.646846 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-caa40185-c3bc-4570-b5df-2d5a96bbbf65 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:13.648177 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-caa40185-c3bc-4570-b5df-2d5a96bbbf65 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.510910 Jan 18 20:26:13.648888 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 267/528] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:13 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:13.691078 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-8d048772-0b19-48a6-9623-dd694ee42eac tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:13.692166 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-8d048772-0b19-48a6-9623-dd694ee42eac tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:13.705021 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8d048772-0b19-48a6-9623-dd694ee42eac tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:13.705887 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8d048772-0b19-48a6-9623-dd694ee42eac tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:13.707483 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8d048772-0b19-48a6-9623-dd694ee42eac tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:13.708743 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8d048772-0b19-48a6-9623-dd694ee42eac tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:13.909593 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-8d048772-0b19-48a6-9623-dd694ee42eac tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:13.917188 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-8d048772-0b19-48a6-9623-dd694ee42eac tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1507 microversion: 2.1 time: 0.233233 Jan 18 20:26:13.917759 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 262/529] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:13 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:14.665523 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b1f22d66-2785-4bfd-8b34-45c56764637c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:14.666781 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b1f22d66-2785-4bfd-8b34-45c56764637c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:14.676467 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b1f22d66-2785-4bfd-8b34-45c56764637c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:14.677391 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b1f22d66-2785-4bfd-8b34-45c56764637c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:14.677979 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b1f22d66-2785-4bfd-8b34-45c56764637c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:14.678515 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b1f22d66-2785-4bfd-8b34-45c56764637c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:14.833004 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b1f22d66-2785-4bfd-8b34-45c56764637c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:14.841351 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b1f22d66-2785-4bfd-8b34-45c56764637c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:14.842995 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b1f22d66-2785-4bfd-8b34-45c56764637c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:14.844509 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b1f22d66-2785-4bfd-8b34-45c56764637c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.182667 Jan 18 20:26:14.845062 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 268/530] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:14 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:14.934121 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4c36ead6-d849-44ed-bae3-a5e599a65ca1 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:14.935495 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-4c36ead6-d849-44ed-bae3-a5e599a65ca1 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:14.947258 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4c36ead6-d849-44ed-bae3-a5e599a65ca1 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:14.947258 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4c36ead6-d849-44ed-bae3-a5e599a65ca1 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:14.947258 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4c36ead6-d849-44ed-bae3-a5e599a65ca1 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:14.947258 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4c36ead6-d849-44ed-bae3-a5e599a65ca1 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:15.121037 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-4c36ead6-d849-44ed-bae3-a5e599a65ca1 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:15.129073 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-4c36ead6-d849-44ed-bae3-a5e599a65ca1 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1507 microversion: 2.1 time: 0.198481 Jan 18 20:26:15.129652 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 263/531] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:14 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:15.864037 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9dea8db3-177e-412e-8e3e-bf7165bf55da tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:15.864644 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9dea8db3-177e-412e-8e3e-bf7165bf55da tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:15.871284 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9dea8db3-177e-412e-8e3e-bf7165bf55da tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:15.872668 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9dea8db3-177e-412e-8e3e-bf7165bf55da tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:15.873723 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9dea8db3-177e-412e-8e3e-bf7165bf55da tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:15.874373 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9dea8db3-177e-412e-8e3e-bf7165bf55da tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:16.036932 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9dea8db3-177e-412e-8e3e-bf7165bf55da tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:16.045880 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9dea8db3-177e-412e-8e3e-bf7165bf55da tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:16.048383 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9dea8db3-177e-412e-8e3e-bf7165bf55da tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:16.050107 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9dea8db3-177e-412e-8e3e-bf7165bf55da tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.189724 Jan 18 20:26:16.050717 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 269/532] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:15 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:16.146235 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ad6e44d4-b43a-46d2-9cb5-446a1fb7b895 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:16.147135 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ad6e44d4-b43a-46d2-9cb5-446a1fb7b895 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:16.154015 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ad6e44d4-b43a-46d2-9cb5-446a1fb7b895 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:16.154514 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ad6e44d4-b43a-46d2-9cb5-446a1fb7b895 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:16.156305 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ad6e44d4-b43a-46d2-9cb5-446a1fb7b895 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:16.156855 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ad6e44d4-b43a-46d2-9cb5-446a1fb7b895 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:16.325198 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-ad6e44d4-b43a-46d2-9cb5-446a1fb7b895 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:16.333760 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ad6e44d4-b43a-46d2-9cb5-446a1fb7b895 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1507 microversion: 2.1 time: 0.191233 Jan 18 20:26:16.334355 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 264/533] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:16 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:17.070834 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4b8df9b0-ab19-4642-a7f6-21130973e38c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:17.071612 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4b8df9b0-ab19-4642-a7f6-21130973e38c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:17.080381 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4b8df9b0-ab19-4642-a7f6-21130973e38c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:17.081320 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4b8df9b0-ab19-4642-a7f6-21130973e38c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:17.082452 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4b8df9b0-ab19-4642-a7f6-21130973e38c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:17.083324 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4b8df9b0-ab19-4642-a7f6-21130973e38c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:17.236722 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4b8df9b0-ab19-4642-a7f6-21130973e38c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:17.247255 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4b8df9b0-ab19-4642-a7f6-21130973e38c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:17.249376 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4b8df9b0-ab19-4642-a7f6-21130973e38c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:17.251020 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4b8df9b0-ab19-4642-a7f6-21130973e38c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.184418 Jan 18 20:26:17.261978 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 270/534] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:17 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:26:17.359580 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-886b0bae-1997-4e92-9560-4b1e5e2857ca tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:17.360128 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-886b0bae-1997-4e92-9560-4b1e5e2857ca tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:17.366585 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-886b0bae-1997-4e92-9560-4b1e5e2857ca tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:17.367056 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-886b0bae-1997-4e92-9560-4b1e5e2857ca tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:17.367855 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-886b0bae-1997-4e92-9560-4b1e5e2857ca tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:17.368292 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-886b0bae-1997-4e92-9560-4b1e5e2857ca tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:17.519926 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-886b0bae-1997-4e92-9560-4b1e5e2857ca tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:17.527481 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-886b0bae-1997-4e92-9560-4b1e5e2857ca tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1507 microversion: 2.1 time: 0.171652 Jan 18 20:26:17.528058 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 265/535] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:17 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:18.269568 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-887a95d9-5e0e-4e5b-ada3-8c8e35aabe83 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:18.270420 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-887a95d9-5e0e-4e5b-ada3-8c8e35aabe83 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:18.277229 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-887a95d9-5e0e-4e5b-ada3-8c8e35aabe83 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:18.277780 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-887a95d9-5e0e-4e5b-ada3-8c8e35aabe83 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:18.278715 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-887a95d9-5e0e-4e5b-ada3-8c8e35aabe83 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:18.279353 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-887a95d9-5e0e-4e5b-ada3-8c8e35aabe83 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:18.487173 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-887a95d9-5e0e-4e5b-ada3-8c8e35aabe83 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:18.497088 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-887a95d9-5e0e-4e5b-ada3-8c8e35aabe83 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:18.498663 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-887a95d9-5e0e-4e5b-ada3-8c8e35aabe83 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:18.499974 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-887a95d9-5e0e-4e5b-ada3-8c8e35aabe83 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.234156 Jan 18 20:26:18.500549 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 271/536] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:18 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:18.553331 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-692163c3-84ab-4a35-b0a8-7f830ab41092 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:18.555614 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-692163c3-84ab-4a35-b0a8-7f830ab41092 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:18.564675 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-692163c3-84ab-4a35-b0a8-7f830ab41092 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:18.565173 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-692163c3-84ab-4a35-b0a8-7f830ab41092 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:18.566005 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-692163c3-84ab-4a35-b0a8-7f830ab41092 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:18.566546 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-692163c3-84ab-4a35-b0a8-7f830ab41092 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:18.789727 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-692163c3-84ab-4a35-b0a8-7f830ab41092 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:18.808349 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-692163c3-84ab-4a35-b0a8-7f830ab41092 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1507 microversion: 2.1 time: 0.265657 Jan 18 20:26:18.809962 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 266/537] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:18 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:19.521951 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e17ef9e5-86bc-46ce-93e3-6d94002afb34 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:19.523649 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e17ef9e5-86bc-46ce-93e3-6d94002afb34 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:19.534957 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e17ef9e5-86bc-46ce-93e3-6d94002afb34 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:19.535749 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e17ef9e5-86bc-46ce-93e3-6d94002afb34 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:19.537288 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e17ef9e5-86bc-46ce-93e3-6d94002afb34 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:19.538020 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e17ef9e5-86bc-46ce-93e3-6d94002afb34 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:19.710272 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e17ef9e5-86bc-46ce-93e3-6d94002afb34 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:19.721612 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e17ef9e5-86bc-46ce-93e3-6d94002afb34 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:19.723290 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e17ef9e5-86bc-46ce-93e3-6d94002afb34 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:19.724563 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e17ef9e5-86bc-46ce-93e3-6d94002afb34 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.209726 Jan 18 20:26:19.725214 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 272/538] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:19 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:19.829061 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-55311fe1-d5e2-4e96-b2e7-8ebcdfdded50 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:19.829723 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-55311fe1-d5e2-4e96-b2e7-8ebcdfdded50 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:19.838773 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-55311fe1-d5e2-4e96-b2e7-8ebcdfdded50 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:19.847518 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-55311fe1-d5e2-4e96-b2e7-8ebcdfdded50 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:19.848532 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-55311fe1-d5e2-4e96-b2e7-8ebcdfdded50 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:19.849009 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-55311fe1-d5e2-4e96-b2e7-8ebcdfdded50 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:20.002690 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-55311fe1-d5e2-4e96-b2e7-8ebcdfdded50 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:20.011324 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-55311fe1-d5e2-4e96-b2e7-8ebcdfdded50 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1507 microversion: 2.1 time: 0.185931 Jan 18 20:26:20.011906 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 267/539] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:19 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:20.750359 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f4d77e2c-87b4-4f3a-b86b-7118ef201ba4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:20.752338 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f4d77e2c-87b4-4f3a-b86b-7118ef201ba4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:20.764679 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f4d77e2c-87b4-4f3a-b86b-7118ef201ba4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:20.765976 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f4d77e2c-87b4-4f3a-b86b-7118ef201ba4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:20.767013 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f4d77e2c-87b4-4f3a-b86b-7118ef201ba4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:20.767630 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f4d77e2c-87b4-4f3a-b86b-7118ef201ba4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:20.962833 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f4d77e2c-87b4-4f3a-b86b-7118ef201ba4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:20.971733 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f4d77e2c-87b4-4f3a-b86b-7118ef201ba4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:20.973795 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f4d77e2c-87b4-4f3a-b86b-7118ef201ba4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:20.975011 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f4d77e2c-87b4-4f3a-b86b-7118ef201ba4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.228862 Jan 18 20:26:20.975661 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 273/540] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:20 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:26:21.036162 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f52fcd39-fc96-4d7d-a418-169e78a5a962 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:21.037209 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-f52fcd39-fc96-4d7d-a418-169e78a5a962 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:21.045066 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f52fcd39-fc96-4d7d-a418-169e78a5a962 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:21.045654 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f52fcd39-fc96-4d7d-a418-169e78a5a962 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:21.047205 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f52fcd39-fc96-4d7d-a418-169e78a5a962 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:21.047746 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f52fcd39-fc96-4d7d-a418-169e78a5a962 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:21.214384 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-f52fcd39-fc96-4d7d-a418-169e78a5a962 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:21.228088 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-f52fcd39-fc96-4d7d-a418-169e78a5a962 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1507 microversion: 2.1 time: 0.195657 Jan 18 20:26:21.229131 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 268/541] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:21 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:26:21.994012 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9b038ac0-291f-4b85-a61c-d57da678c976 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:21.994627 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9b038ac0-291f-4b85-a61c-d57da678c976 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:22.001713 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b038ac0-291f-4b85-a61c-d57da678c976 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:22.002289 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b038ac0-291f-4b85-a61c-d57da678c976 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:22.003238 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b038ac0-291f-4b85-a61c-d57da678c976 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:22.003969 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b038ac0-291f-4b85-a61c-d57da678c976 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:22.195643 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9b038ac0-291f-4b85-a61c-d57da678c976 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:22.209816 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9b038ac0-291f-4b85-a61c-d57da678c976 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:22.212462 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9b038ac0-291f-4b85-a61c-d57da678c976 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:22.214330 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9b038ac0-291f-4b85-a61c-d57da678c976 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.224049 Jan 18 20:26:22.215276 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 274/542] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:21 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:22.250542 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fa4ff0e4-2af5-4029-8b6a-b03252886e80 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:22.251388 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-fa4ff0e4-2af5-4029-8b6a-b03252886e80 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:22.261101 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fa4ff0e4-2af5-4029-8b6a-b03252886e80 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:22.261553 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fa4ff0e4-2af5-4029-8b6a-b03252886e80 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:22.262464 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fa4ff0e4-2af5-4029-8b6a-b03252886e80 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:22.262979 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fa4ff0e4-2af5-4029-8b6a-b03252886e80 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:22.405580 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-fa4ff0e4-2af5-4029-8b6a-b03252886e80 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:22.413092 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-fa4ff0e4-2af5-4029-8b6a-b03252886e80 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1507 microversion: 2.1 time: 0.169094 Jan 18 20:26:22.413680 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 269/543] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:22 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:23.236797 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6eca65b3-a39e-46a7-ac1c-4bf388f12bb2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:23.238020 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6eca65b3-a39e-46a7-ac1c-4bf388f12bb2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:23.247193 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6eca65b3-a39e-46a7-ac1c-4bf388f12bb2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:23.247657 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6eca65b3-a39e-46a7-ac1c-4bf388f12bb2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:23.248551 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6eca65b3-a39e-46a7-ac1c-4bf388f12bb2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:23.249082 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6eca65b3-a39e-46a7-ac1c-4bf388f12bb2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:23.433323 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d27246c9-0fd2-4cdc-8960-14bc0e47424a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:23.434191 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d27246c9-0fd2-4cdc-8960-14bc0e47424a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:23.445691 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d27246c9-0fd2-4cdc-8960-14bc0e47424a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:23.446486 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d27246c9-0fd2-4cdc-8960-14bc0e47424a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:23.447968 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d27246c9-0fd2-4cdc-8960-14bc0e47424a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:23.448775 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d27246c9-0fd2-4cdc-8960-14bc0e47424a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:23.454631 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6eca65b3-a39e-46a7-ac1c-4bf388f12bb2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:23.468883 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6eca65b3-a39e-46a7-ac1c-4bf388f12bb2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:23.472083 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6eca65b3-a39e-46a7-ac1c-4bf388f12bb2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:23.484758 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6eca65b3-a39e-46a7-ac1c-4bf388f12bb2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.242423 Jan 18 20:26:23.484758 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 275/544] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:23 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:23.651360 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d27246c9-0fd2-4cdc-8960-14bc0e47424a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:23.660577 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d27246c9-0fd2-4cdc-8960-14bc0e47424a tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1507 microversion: 2.1 time: 0.232099 Jan 18 20:26:23.661186 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 270/545] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:23 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1507 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:26:24.345121 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-db1f8f01-79b4-4051-a9ba-577eb2a053ab req-c24ec8a9-0781-4648-9b1d-56a7d77f03f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6", "name": "network-vif-deleted", "tag": "81368d94-6b86-4c1a-84ec-fc21d1647ac5"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:26:24.348347 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:26:24.348347 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:26:24.365904 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-db1f8f01-79b4-4051-a9ba-577eb2a053ab req-c24ec8a9-0781-4648-9b1d-56a7d77f03f2 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:24.368114 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-db1f8f01-79b4-4051-a9ba-577eb2a053ab req-c24ec8a9-0781-4648-9b1d-56a7d77f03f2 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:24.394915 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-db1f8f01-79b4-4051-a9ba-577eb2a053ab req-c24ec8a9-0781-4648-9b1d-56a7d77f03f2 service nova] Creating event network-vif-deleted:81368d94-6b86-4c1a-84ec-fc21d1647ac5 for instance 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 on hv-cinder-82160 Jan 18 20:26:24.408742 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-db1f8f01-79b4-4051-a9ba-577eb2a053ab req-c24ec8a9-0781-4648-9b1d-56a7d77f03f2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067443 Jan 18 20:26:24.412956 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 276/546] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:26:24.504953 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-10857f08-f17b-4c45-8862-4004824d550c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:24.505913 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-10857f08-f17b-4c45-8862-4004824d550c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:24.514160 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-10857f08-f17b-4c45-8862-4004824d550c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:24.514793 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-10857f08-f17b-4c45-8862-4004824d550c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:24.515760 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-10857f08-f17b-4c45-8862-4004824d550c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:24.516318 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-10857f08-f17b-4c45-8862-4004824d550c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:24.681923 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-10857f08-f17b-4c45-8862-4004824d550c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:24.691946 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d18e2c2b-99bc-4d88-b3c8-68b45f76c5ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:24.694945 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d18e2c2b-99bc-4d88-b3c8-68b45f76c5ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:24.700940 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-10857f08-f17b-4c45-8862-4004824d550c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:24.705125 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-10857f08-f17b-4c45-8862-4004824d550c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:24.707977 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-10857f08-f17b-4c45-8862-4004824d550c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.209335 Jan 18 20:26:24.708750 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d18e2c2b-99bc-4d88-b3c8-68b45f76c5ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:24.709241 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 271/547] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:24 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:24.710048 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d18e2c2b-99bc-4d88-b3c8-68b45f76c5ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:24.711660 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d18e2c2b-99bc-4d88-b3c8-68b45f76c5ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:24.712658 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d18e2c2b-99bc-4d88-b3c8-68b45f76c5ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:24.766017 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d18e2c2b-99bc-4d88-b3c8-68b45f76c5ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:24.767093 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d18e2c2b-99bc-4d88-b3c8-68b45f76c5ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:24.767829 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-d18e2c2b-99bc-4d88-b3c8-68b45f76c5ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lazy-loading 'fault' on Instance uuid 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:26:24.844782 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d18e2c2b-99bc-4d88-b3c8-68b45f76c5ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:24.863162 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d18e2c2b-99bc-4d88-b3c8-68b45f76c5ae tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 200 len: 1312 microversion: 2.1 time: 0.179601 Jan 18 20:26:24.878679 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 277/548] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:24 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:26:25.736026 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b9cbaf07-f012-41c3-901c-a817b69bc063 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:25.737275 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b9cbaf07-f012-41c3-901c-a817b69bc063 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:25.743698 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b9cbaf07-f012-41c3-901c-a817b69bc063 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:25.744155 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b9cbaf07-f012-41c3-901c-a817b69bc063 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:25.744952 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b9cbaf07-f012-41c3-901c-a817b69bc063 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:25.745394 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b9cbaf07-f012-41c3-901c-a817b69bc063 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:25.888451 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c81278e2-3fb1-485a-a7e8-dbe5d1d718d9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:25.890951 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c81278e2-3fb1-485a-a7e8-dbe5d1d718d9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:25.902189 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c81278e2-3fb1-485a-a7e8-dbe5d1d718d9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:25.903542 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c81278e2-3fb1-485a-a7e8-dbe5d1d718d9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:25.906036 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c81278e2-3fb1-485a-a7e8-dbe5d1d718d9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:25.907274 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c81278e2-3fb1-485a-a7e8-dbe5d1d718d9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:25.934138 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-c81278e2-3fb1-485a-a7e8-dbe5d1d718d9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] HTTP exception thrown: Instance 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 could not be found. Jan 18 20:26:25.935025 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c81278e2-3fb1-485a-a7e8-dbe5d1d718d9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Returning 404 to user: Instance 04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:26:25.936435 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c81278e2-3fb1-485a-a7e8-dbe5d1d718d9 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6" status: 404 len: 111 microversion: 2.1 time: 0.054709 Jan 18 20:26:25.939228 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 278/549] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:25 2022] GET /compute/v2.1/servers/04fe7fc1-50f5-4cd8-b7ca-a7c5383154e6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:26:25.954509 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0b52679f-8d87-4163-acf8-a0b090565764 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:25.955729 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0b52679f-8d87-4163-acf8-a0b090565764 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:25.958965 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b9cbaf07-f012-41c3-901c-a817b69bc063 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:25.968889 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0b52679f-8d87-4163-acf8-a0b090565764 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:25.969985 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0b52679f-8d87-4163-acf8-a0b090565764 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:25.971641 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b9cbaf07-f012-41c3-901c-a817b69bc063 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:25.971795 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0b52679f-8d87-4163-acf8-a0b090565764 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:25.973903 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0b52679f-8d87-4163-acf8-a0b090565764 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:25.974149 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b9cbaf07-f012-41c3-901c-a817b69bc063 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:25.975398 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b9cbaf07-f012-41c3-901c-a817b69bc063 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.243934 Jan 18 20:26:25.976403 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 272/550] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:25 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:26.016893 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0b52679f-8d87-4163-acf8-a0b090565764 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:26:26.104541 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0b52679f-8d87-4163-acf8-a0b090565764 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "DELETE /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 204 len: 0 microversion: 2.1 time: 0.159948 Jan 18 20:26:26.105464 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 279/551] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:26:25 2022] DELETE /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 18 20:26:26.115538 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b36cef15-8910-4fa1-960f-bd3d83575eb8 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:26.116052 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b36cef15-8910-4fa1-960f-bd3d83575eb8 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:26.122967 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b36cef15-8910-4fa1-960f-bd3d83575eb8 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:26.123515 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b36cef15-8910-4fa1-960f-bd3d83575eb8 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:26.124360 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b36cef15-8910-4fa1-960f-bd3d83575eb8 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:26.124836 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b36cef15-8910-4fa1-960f-bd3d83575eb8 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:26.497768 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b36cef15-8910-4fa1-960f-bd3d83575eb8 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:26.506919 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b36cef15-8910-4fa1-960f-bd3d83575eb8 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1521 microversion: 2.1 time: 0.395434 Jan 18 20:26:26.507570 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 273/552] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:26 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:27.009066 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-51e1f225-0d12-4b83-9a68-d0500bef5085 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:27.010259 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-51e1f225-0d12-4b83-9a68-d0500bef5085 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:27.019623 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-51e1f225-0d12-4b83-9a68-d0500bef5085 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:27.020118 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-51e1f225-0d12-4b83-9a68-d0500bef5085 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:27.020969 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-51e1f225-0d12-4b83-9a68-d0500bef5085 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:27.021477 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-51e1f225-0d12-4b83-9a68-d0500bef5085 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:27.225467 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-51e1f225-0d12-4b83-9a68-d0500bef5085 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:27.235690 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-51e1f225-0d12-4b83-9a68-d0500bef5085 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:27.237225 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-51e1f225-0d12-4b83-9a68-d0500bef5085 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:27.238449 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-51e1f225-0d12-4b83-9a68-d0500bef5085 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.236262 Jan 18 20:26:27.239128 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 280/553] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:27 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:27.524793 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-2467ad3b-62fc-442f-aae5-52e30ac1955b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:27.525480 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-2467ad3b-62fc-442f-aae5-52e30ac1955b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:27.533650 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2467ad3b-62fc-442f-aae5-52e30ac1955b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:27.534247 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2467ad3b-62fc-442f-aae5-52e30ac1955b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:27.535204 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2467ad3b-62fc-442f-aae5-52e30ac1955b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:27.535752 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2467ad3b-62fc-442f-aae5-52e30ac1955b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:27.717184 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-2467ad3b-62fc-442f-aae5-52e30ac1955b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:27.730737 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2467ad3b-62fc-442f-aae5-52e30ac1955b tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1521 microversion: 2.1 time: 0.209358 Jan 18 20:26:27.732198 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 274/554] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:27 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:28.261048 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4edf2c4f-9935-4656-a523-2edf40d3a36c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:28.261659 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4edf2c4f-9935-4656-a523-2edf40d3a36c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:28.269006 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4edf2c4f-9935-4656-a523-2edf40d3a36c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:28.269451 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4edf2c4f-9935-4656-a523-2edf40d3a36c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:28.270231 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4edf2c4f-9935-4656-a523-2edf40d3a36c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:28.270660 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4edf2c4f-9935-4656-a523-2edf40d3a36c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:28.414956 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4edf2c4f-9935-4656-a523-2edf40d3a36c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:28.424816 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4edf2c4f-9935-4656-a523-2edf40d3a36c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:28.426339 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4edf2c4f-9935-4656-a523-2edf40d3a36c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:28.427560 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4edf2c4f-9935-4656-a523-2edf40d3a36c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.170229 Jan 18 20:26:28.428131 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 281/555] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:28 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:28.756338 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-19aadb09-5196-43a4-b0a5-3755a8131284 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:28.757214 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-19aadb09-5196-43a4-b0a5-3755a8131284 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:28.764228 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-19aadb09-5196-43a4-b0a5-3755a8131284 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:28.764788 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-19aadb09-5196-43a4-b0a5-3755a8131284 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:28.765698 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-19aadb09-5196-43a4-b0a5-3755a8131284 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:28.766224 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-19aadb09-5196-43a4-b0a5-3755a8131284 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:28.924046 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-19aadb09-5196-43a4-b0a5-3755a8131284 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:28.934625 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-19aadb09-5196-43a4-b0a5-3755a8131284 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1521 microversion: 2.1 time: 0.181951 Jan 18 20:26:28.935316 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 275/556] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:28 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:26:29.446893 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9f35fbfa-9c8d-4bf9-ac46-ddd731978d8d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:29.447922 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9f35fbfa-9c8d-4bf9-ac46-ddd731978d8d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:29.455273 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f35fbfa-9c8d-4bf9-ac46-ddd731978d8d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:29.455718 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f35fbfa-9c8d-4bf9-ac46-ddd731978d8d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:29.456731 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f35fbfa-9c8d-4bf9-ac46-ddd731978d8d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:29.457162 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f35fbfa-9c8d-4bf9-ac46-ddd731978d8d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:29.610919 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9f35fbfa-9c8d-4bf9-ac46-ddd731978d8d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:29.620139 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9f35fbfa-9c8d-4bf9-ac46-ddd731978d8d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:29.621658 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9f35fbfa-9c8d-4bf9-ac46-ddd731978d8d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:29.622864 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9f35fbfa-9c8d-4bf9-ac46-ddd731978d8d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.180026 Jan 18 20:26:29.623458 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 282/557] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:29 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:29.952237 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f2daaf6c-5726-40c3-9e43-7cb38ec654d3 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:29.953271 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-f2daaf6c-5726-40c3-9e43-7cb38ec654d3 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:29.960479 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f2daaf6c-5726-40c3-9e43-7cb38ec654d3 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:29.961073 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f2daaf6c-5726-40c3-9e43-7cb38ec654d3 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:29.961976 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f2daaf6c-5726-40c3-9e43-7cb38ec654d3 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:29.962476 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f2daaf6c-5726-40c3-9e43-7cb38ec654d3 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:30.111173 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-f2daaf6c-5726-40c3-9e43-7cb38ec654d3 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:30.120034 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-f2daaf6c-5726-40c3-9e43-7cb38ec654d3 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1521 microversion: 2.1 time: 0.171616 Jan 18 20:26:30.120750 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 276/558] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:29 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:30.642282 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-439d5bcd-3987-42c8-9872-5873c422e8dd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:30.642940 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-439d5bcd-3987-42c8-9872-5873c422e8dd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:30.650209 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-439d5bcd-3987-42c8-9872-5873c422e8dd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:30.650865 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-439d5bcd-3987-42c8-9872-5873c422e8dd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:30.651757 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-439d5bcd-3987-42c8-9872-5873c422e8dd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:30.652232 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-439d5bcd-3987-42c8-9872-5873c422e8dd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:30.805781 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-439d5bcd-3987-42c8-9872-5873c422e8dd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:30.815154 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-439d5bcd-3987-42c8-9872-5873c422e8dd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:30.816676 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-439d5bcd-3987-42c8-9872-5873c422e8dd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:30.817871 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-439d5bcd-3987-42c8-9872-5873c422e8dd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.180071 Jan 18 20:26:30.818443 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 283/559] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:30 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:31.140686 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-75da439a-6c18-4714-8dc6-362fb3c0148e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:31.141707 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-75da439a-6c18-4714-8dc6-362fb3c0148e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:31.150333 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-75da439a-6c18-4714-8dc6-362fb3c0148e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:31.151246 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-75da439a-6c18-4714-8dc6-362fb3c0148e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:31.152227 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-75da439a-6c18-4714-8dc6-362fb3c0148e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:31.152770 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-75da439a-6c18-4714-8dc6-362fb3c0148e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:31.352804 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-75da439a-6c18-4714-8dc6-362fb3c0148e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:31.368499 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-75da439a-6c18-4714-8dc6-362fb3c0148e tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1521 microversion: 2.1 time: 0.232283 Jan 18 20:26:31.369817 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 277/560] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:31 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:31.837206 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1225a968-c801-4b98-9f4b-f92c8f09d9a5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:31.837846 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1225a968-c801-4b98-9f4b-f92c8f09d9a5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:31.848660 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1225a968-c801-4b98-9f4b-f92c8f09d9a5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:31.849472 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1225a968-c801-4b98-9f4b-f92c8f09d9a5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:31.850946 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1225a968-c801-4b98-9f4b-f92c8f09d9a5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:31.851771 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1225a968-c801-4b98-9f4b-f92c8f09d9a5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:32.027423 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1225a968-c801-4b98-9f4b-f92c8f09d9a5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:32.043692 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1225a968-c801-4b98-9f4b-f92c8f09d9a5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:32.047534 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1225a968-c801-4b98-9f4b-f92c8f09d9a5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:32.050006 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1225a968-c801-4b98-9f4b-f92c8f09d9a5 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.216352 Jan 18 20:26:32.051007 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 284/561] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:31 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:26:32.392185 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-341072f0-e3ed-46f6-96a7-d3010892d311 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:32.393512 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-341072f0-e3ed-46f6-96a7-d3010892d311 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:32.406885 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-341072f0-e3ed-46f6-96a7-d3010892d311 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:32.407689 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-341072f0-e3ed-46f6-96a7-d3010892d311 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:32.409172 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-341072f0-e3ed-46f6-96a7-d3010892d311 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:32.409962 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-341072f0-e3ed-46f6-96a7-d3010892d311 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:32.622136 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-341072f0-e3ed-46f6-96a7-d3010892d311 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:32.631950 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-341072f0-e3ed-46f6-96a7-d3010892d311 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1521 microversion: 2.1 time: 0.246819 Jan 18 20:26:32.632775 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 278/562] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:32 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:33.079567 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-01632b64-11f9-4d7d-9be7-afbd7304c38d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:33.080545 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-01632b64-11f9-4d7d-9be7-afbd7304c38d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:33.088224 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-01632b64-11f9-4d7d-9be7-afbd7304c38d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:33.088757 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-01632b64-11f9-4d7d-9be7-afbd7304c38d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:33.089736 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-01632b64-11f9-4d7d-9be7-afbd7304c38d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:33.090541 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-01632b64-11f9-4d7d-9be7-afbd7304c38d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:33.171008 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-953e456d-68e1-4140-950d-2939754f89c7 req-a4eb7d9e-12a7-4730-98f1-6be17a6bcabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712e0492-0709-4ab3-a1e2-5999b562d3fc", "name": "network-vif-deleted", "tag": "775e3527-9a3d-4cae-a31c-6d0726c10e34"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:26:33.174304 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:26:33.174304 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:26:33.187647 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-953e456d-68e1-4140-950d-2939754f89c7 req-a4eb7d9e-12a7-4730-98f1-6be17a6bcabf service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:33.188920 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-953e456d-68e1-4140-950d-2939754f89c7 req-a4eb7d9e-12a7-4730-98f1-6be17a6bcabf service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:33.203168 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-953e456d-68e1-4140-950d-2939754f89c7 req-a4eb7d9e-12a7-4730-98f1-6be17a6bcabf service nova] Creating event network-vif-deleted:775e3527-9a3d-4cae-a31c-6d0726c10e34 for instance 712e0492-0709-4ab3-a1e2-5999b562d3fc on hv-cinder-82160 Jan 18 20:26:33.209122 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-953e456d-68e1-4140-950d-2939754f89c7 req-a4eb7d9e-12a7-4730-98f1-6be17a6bcabf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044995 Jan 18 20:26:33.210001 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 279/563] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:26:33.320265 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-01632b64-11f9-4d7d-9be7-afbd7304c38d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:33.337010 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-01632b64-11f9-4d7d-9be7-afbd7304c38d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:33.340318 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-01632b64-11f9-4d7d-9be7-afbd7304c38d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:33.343231 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-01632b64-11f9-4d7d-9be7-afbd7304c38d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.267732 Jan 18 20:26:33.344388 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 285/564] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:33 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:33.661003 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-313d76f0-5363-4884-b56f-18960ea0a061 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:33.662500 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-313d76f0-5363-4884-b56f-18960ea0a061 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:33.672924 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-313d76f0-5363-4884-b56f-18960ea0a061 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:33.674162 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-313d76f0-5363-4884-b56f-18960ea0a061 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:33.675177 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-313d76f0-5363-4884-b56f-18960ea0a061 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:33.675768 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-313d76f0-5363-4884-b56f-18960ea0a061 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:33.720307 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-313d76f0-5363-4884-b56f-18960ea0a061 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:33.721094 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-313d76f0-5363-4884-b56f-18960ea0a061 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:33.721481 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.objects.instance [None req-313d76f0-5363-4884-b56f-18960ea0a061 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lazy-loading 'fault' on Instance uuid 712e0492-0709-4ab3-a1e2-5999b562d3fc {{(pid=116376) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:26:33.780292 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-313d76f0-5363-4884-b56f-18960ea0a061 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69daca25d99340b6bba224d51a958852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05e2986ebac459eaec991a4315a88d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:33.788562 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-313d76f0-5363-4884-b56f-18960ea0a061 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 200 len: 1312 microversion: 2.1 time: 0.133634 Jan 18 20:26:33.789174 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 280/565] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:33 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 1312 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:26:34.369177 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7462d404-3b22-45ae-b97a-4741744c759b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:34.370030 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7462d404-3b22-45ae-b97a-4741744c759b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:34.377037 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7462d404-3b22-45ae-b97a-4741744c759b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:34.377484 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7462d404-3b22-45ae-b97a-4741744c759b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:34.378296 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7462d404-3b22-45ae-b97a-4741744c759b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:34.378731 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7462d404-3b22-45ae-b97a-4741744c759b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:34.533305 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7462d404-3b22-45ae-b97a-4741744c759b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:34.550481 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7462d404-3b22-45ae-b97a-4741744c759b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:34.553886 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7462d404-3b22-45ae-b97a-4741744c759b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:34.556248 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7462d404-3b22-45ae-b97a-4741744c759b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.190731 Jan 18 20:26:34.557523 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 286/566] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:34 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:34.809966 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-785b6e15-a118-47a0-97b9-b31dff6f036d req-4cebc24a-9503-4581-b9ae-24161dd1a85c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54f16911-8813-49b1-a940-9d83c6a5b131", "name": "network-vif-plugged", "status": "completed", "tag": "555e1e24-9775-40bc-b590-9ec8763d4dd0"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:26:34.814160 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:26:34.814160 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:26:34.819662 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-75e5abdc-cfa1-491b-bb93-8244e66811c3 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:34.821037 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-75e5abdc-cfa1-491b-bb93-8244e66811c3 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] [instance: 712e0492-0709-4ab3-a1e2-5999b562d3fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:34.825536 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-785b6e15-a118-47a0-97b9-b31dff6f036d req-4cebc24a-9503-4581-b9ae-24161dd1a85c service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:34.827342 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-785b6e15-a118-47a0-97b9-b31dff6f036d req-4cebc24a-9503-4581-b9ae-24161dd1a85c service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:34.835010 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-75e5abdc-cfa1-491b-bb93-8244e66811c3 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:34.836038 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-75e5abdc-cfa1-491b-bb93-8244e66811c3 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:34.837807 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-75e5abdc-cfa1-491b-bb93-8244e66811c3 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:34.838669 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-75e5abdc-cfa1-491b-bb93-8244e66811c3 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:34.847570 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-785b6e15-a118-47a0-97b9-b31dff6f036d req-4cebc24a-9503-4581-b9ae-24161dd1a85c service nova] Creating event network-vif-plugged:555e1e24-9775-40bc-b590-9ec8763d4dd0 for instance 54f16911-8813-49b1-a940-9d83c6a5b131 on hv-cinder-82160 Jan 18 20:26:34.855007 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-785b6e15-a118-47a0-97b9-b31dff6f036d req-4cebc24a-9503-4581-b9ae-24161dd1a85c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049424 Jan 18 20:26:34.856731 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 281/567] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:26:34.861023 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-75e5abdc-cfa1-491b-bb93-8244e66811c3 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] HTTP exception thrown: Instance 712e0492-0709-4ab3-a1e2-5999b562d3fc could not be found. Jan 18 20:26:34.861702 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-75e5abdc-cfa1-491b-bb93-8244e66811c3 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] Returning 404 to user: Instance 712e0492-0709-4ab3-a1e2-5999b562d3fc could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:26:34.862563 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-75e5abdc-cfa1-491b-bb93-8244e66811c3 tempest-ServerRescueNegativeTestJSON-88320996 tempest-ServerRescueNegativeTestJSON-88320996-project] 10.222.0.67 "GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc" status: 404 len: 111 microversion: 2.1 time: 0.051567 Jan 18 20:26:34.868794 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 287/568] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:34 2022] GET /compute/v2.1/servers/712e0492-0709-4ab3-a1e2-5999b562d3fc => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:26:35.586877 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b9f6325b-27dd-40de-95b7-9e7bd71a5c20 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:35.587753 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b9f6325b-27dd-40de-95b7-9e7bd71a5c20 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:35.595111 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b9f6325b-27dd-40de-95b7-9e7bd71a5c20 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:35.595558 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b9f6325b-27dd-40de-95b7-9e7bd71a5c20 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:35.596356 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b9f6325b-27dd-40de-95b7-9e7bd71a5c20 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:35.596787 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b9f6325b-27dd-40de-95b7-9e7bd71a5c20 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:35.761277 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b9f6325b-27dd-40de-95b7-9e7bd71a5c20 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:35.770658 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b9f6325b-27dd-40de-95b7-9e7bd71a5c20 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:35.772498 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b9f6325b-27dd-40de-95b7-9e7bd71a5c20 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:35.773710 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b9f6325b-27dd-40de-95b7-9e7bd71a5c20 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.191233 Jan 18 20:26:35.774456 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 282/569] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:35 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:36.797835 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-196d7285-7b26-4327-bcf5-24bdd37decef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:36.799953 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-196d7285-7b26-4327-bcf5-24bdd37decef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:36.809585 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-196d7285-7b26-4327-bcf5-24bdd37decef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:36.810519 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-196d7285-7b26-4327-bcf5-24bdd37decef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:36.812463 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-196d7285-7b26-4327-bcf5-24bdd37decef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:36.813101 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-196d7285-7b26-4327-bcf5-24bdd37decef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:37.112519 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-196d7285-7b26-4327-bcf5-24bdd37decef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:37.122550 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-196d7285-7b26-4327-bcf5-24bdd37decef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:37.129656 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-196d7285-7b26-4327-bcf5-24bdd37decef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:37.138663 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-196d7285-7b26-4327-bcf5-24bdd37decef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1807 microversion: 2.20 time: 0.347478 Jan 18 20:26:37.140308 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 288/570] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:36 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1807 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:26:38.158740 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-9a997969-380b-4127-859f-7fdf7f28d49b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:38.159635 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-9a997969-380b-4127-859f-7fdf7f28d49b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:38.168534 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9a997969-380b-4127-859f-7fdf7f28d49b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:38.169002 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9a997969-380b-4127-859f-7fdf7f28d49b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:38.170250 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9a997969-380b-4127-859f-7fdf7f28d49b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:38.171428 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9a997969-380b-4127-859f-7fdf7f28d49b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:38.511476 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-9a997969-380b-4127-859f-7fdf7f28d49b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:38.529516 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-9a997969-380b-4127-859f-7fdf7f28d49b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:38.532737 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-9a997969-380b-4127-859f-7fdf7f28d49b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:38.535170 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-9a997969-380b-4127-859f-7fdf7f28d49b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1794 microversion: 2.20 time: 0.380293 Jan 18 20:26:38.536937 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 283/571] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:26:38 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1794 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:26:38.945020 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7214abb6-6667-4747-97bb-04a0fb4df017 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:38.945906 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7214abb6-6667-4747-97bb-04a0fb4df017 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:38.963745 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7214abb6-6667-4747-97bb-04a0fb4df017 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:38.964504 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7214abb6-6667-4747-97bb-04a0fb4df017 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:38.965904 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7214abb6-6667-4747-97bb-04a0fb4df017 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:38.966655 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7214abb6-6667-4747-97bb-04a0fb4df017 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:39.126646 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-7214abb6-6667-4747-97bb-04a0fb4df017 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lazy-loading 'services' on Instance uuid b6e08025-ad66-4921-8672-ab55c85cbfb4 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:26:39.264912 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7214abb6-6667-4747-97bb-04a0fb4df017 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/os-volume_attachments/b08228c9-f2ea-476f-ae85-bc9b98a7b338" status: 202 len: 0 microversion: 2.1 time: 0.321604 Jan 18 20:26:39.266012 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 289/572] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Jan 18 20:26:38 2022] DELETE /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/os-volume_attachments/b08228c9-f2ea-476f-ae85-bc9b98a7b338 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:26:39.323104 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 20:26:39.323904 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: Tue Jan 18 20:26:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 20:26:40.410799 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-6b9220ba-b285-4975-bb5c-fa965e6d9d09 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:26:40.418146 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6b9220ba-b285-4975-bb5c-fa965e6d9d09 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:40.418890 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6b9220ba-b285-4975-bb5c-fa965e6d9d09 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:40.511657 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-6b9220ba-b285-4975-bb5c-fa965e6d9d09 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Going to try to stop instance {{(pid=116376) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 18 20:26:40.572493 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-6b9220ba-b285-4975-bb5c-fa965e6d9d09 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 202 len: 0 microversion: 2.1 time: 0.166766 Jan 18 20:26:40.577652 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 284/573] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:26:40 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:26:40.599873 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ae98dc83-5a7a-4855-9b44-c8d7178501d1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:40.609834 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ae98dc83-5a7a-4855-9b44-c8d7178501d1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:40.625158 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ae98dc83-5a7a-4855-9b44-c8d7178501d1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:40.625896 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ae98dc83-5a7a-4855-9b44-c8d7178501d1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:40.626563 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ae98dc83-5a7a-4855-9b44-c8d7178501d1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:40.626999 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ae98dc83-5a7a-4855-9b44-c8d7178501d1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:40.817801 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ae98dc83-5a7a-4855-9b44-c8d7178501d1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:40.826033 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ae98dc83-5a7a-4855-9b44-c8d7178501d1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1676 microversion: 2.1 time: 0.237958 Jan 18 20:26:40.827780 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 290/574] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:40 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1676 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:41.860544 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-8bf35a10-10af-443c-adf4-5a15d58ad307 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:41.861275 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-8bf35a10-10af-443c-adf4-5a15d58ad307 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:41.867927 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8bf35a10-10af-443c-adf4-5a15d58ad307 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:41.868378 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8bf35a10-10af-443c-adf4-5a15d58ad307 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:41.869207 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8bf35a10-10af-443c-adf4-5a15d58ad307 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:41.870124 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8bf35a10-10af-443c-adf4-5a15d58ad307 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:42.073905 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-8bf35a10-10af-443c-adf4-5a15d58ad307 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:42.082286 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-8bf35a10-10af-443c-adf4-5a15d58ad307 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1676 microversion: 2.1 time: 0.227064 Jan 18 20:26:42.083166 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 285/575] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:41 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:43.112246 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-86badded-5757-4329-a3cd-4253cabd89ce tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:43.112863 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-86badded-5757-4329-a3cd-4253cabd89ce tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:43.119644 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-86badded-5757-4329-a3cd-4253cabd89ce tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:43.120085 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-86badded-5757-4329-a3cd-4253cabd89ce tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:43.120889 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-86badded-5757-4329-a3cd-4253cabd89ce tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:43.121321 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-86badded-5757-4329-a3cd-4253cabd89ce tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:43.268986 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-86badded-5757-4329-a3cd-4253cabd89ce tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:43.277254 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-86badded-5757-4329-a3cd-4253cabd89ce tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1676 microversion: 2.1 time: 0.169019 Jan 18 20:26:43.278044 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 291/576] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:43 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:44.294084 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b6d694b8-60c4-49f8-bcab-de6182cafa07 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:44.294808 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b6d694b8-60c4-49f8-bcab-de6182cafa07 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:44.302409 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b6d694b8-60c4-49f8-bcab-de6182cafa07 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:44.302940 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b6d694b8-60c4-49f8-bcab-de6182cafa07 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:44.303826 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b6d694b8-60c4-49f8-bcab-de6182cafa07 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:44.304336 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b6d694b8-60c4-49f8-bcab-de6182cafa07 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:44.443606 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b6d694b8-60c4-49f8-bcab-de6182cafa07 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:44.451618 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b6d694b8-60c4-49f8-bcab-de6182cafa07 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1676 microversion: 2.1 time: 0.161082 Jan 18 20:26:44.452529 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 286/577] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:44 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:45.470230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e76c6b07-9c10-463a-a389-82cd7cec84bc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:45.470878 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e76c6b07-9c10-463a-a389-82cd7cec84bc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:45.477819 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e76c6b07-9c10-463a-a389-82cd7cec84bc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:45.478268 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e76c6b07-9c10-463a-a389-82cd7cec84bc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:45.479072 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e76c6b07-9c10-463a-a389-82cd7cec84bc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:45.479505 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e76c6b07-9c10-463a-a389-82cd7cec84bc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:45.620008 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e76c6b07-9c10-463a-a389-82cd7cec84bc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:45.628152 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e76c6b07-9c10-463a-a389-82cd7cec84bc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1676 microversion: 2.1 time: 0.161468 Jan 18 20:26:45.628719 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 292/578] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:45 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:46.649391 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e3f7b426-0b6b-40b8-922b-8683cc9d6c5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:46.650642 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e3f7b426-0b6b-40b8-922b-8683cc9d6c5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:46.662553 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e3f7b426-0b6b-40b8-922b-8683cc9d6c5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:46.663490 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e3f7b426-0b6b-40b8-922b-8683cc9d6c5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:46.664896 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e3f7b426-0b6b-40b8-922b-8683cc9d6c5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:46.666623 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e3f7b426-0b6b-40b8-922b-8683cc9d6c5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:46.818046 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-e3f7b426-0b6b-40b8-922b-8683cc9d6c5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:46.825478 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e3f7b426-0b6b-40b8-922b-8683cc9d6c5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1676 microversion: 2.1 time: 0.182984 Jan 18 20:26:46.826048 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 287/579] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:46 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:47.724647 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 20:26:47.725128 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: Tue Jan 18 20:26:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 20:26:47.844112 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-62dc4498-d1e8-4638-930e-b463984448e9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:47.844718 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-62dc4498-d1e8-4638-930e-b463984448e9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:47.852059 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-62dc4498-d1e8-4638-930e-b463984448e9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:47.852509 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-62dc4498-d1e8-4638-930e-b463984448e9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:47.854063 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-62dc4498-d1e8-4638-930e-b463984448e9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:47.854926 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-62dc4498-d1e8-4638-930e-b463984448e9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:47.985711 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-62dc4498-d1e8-4638-930e-b463984448e9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:47.993522 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-62dc4498-d1e8-4638-930e-b463984448e9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1676 microversion: 2.1 time: 0.154067 Jan 18 20:26:47.994116 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 293/580] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:47 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:49.011209 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-737b4498-fc9a-41f0-baca-04100b4d3710 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:49.012055 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-737b4498-fc9a-41f0-baca-04100b4d3710 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:49.018618 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-737b4498-fc9a-41f0-baca-04100b4d3710 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:49.019127 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-737b4498-fc9a-41f0-baca-04100b4d3710 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:49.019911 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-737b4498-fc9a-41f0-baca-04100b4d3710 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:49.020336 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-737b4498-fc9a-41f0-baca-04100b4d3710 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:49.173900 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-737b4498-fc9a-41f0-baca-04100b4d3710 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:49.181855 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-737b4498-fc9a-41f0-baca-04100b4d3710 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1676 microversion: 2.1 time: 0.174374 Jan 18 20:26:49.182452 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 288/581] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:49 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:50.202094 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0efda72a-b5b6-42e1-b3d0-106842695312 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:50.202748 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0efda72a-b5b6-42e1-b3d0-106842695312 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:50.209310 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0efda72a-b5b6-42e1-b3d0-106842695312 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:50.209528 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0efda72a-b5b6-42e1-b3d0-106842695312 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:50.210383 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0efda72a-b5b6-42e1-b3d0-106842695312 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:50.210814 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0efda72a-b5b6-42e1-b3d0-106842695312 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:50.368072 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0efda72a-b5b6-42e1-b3d0-106842695312 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:50.376338 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0efda72a-b5b6-42e1-b3d0-106842695312 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1676 microversion: 2.1 time: 0.179799 Jan 18 20:26:50.376919 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 294/582] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:50 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:51.394736 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-dd1639d6-00c9-41e2-9839-ca02b2c69327 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:51.395406 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-dd1639d6-00c9-41e2-9839-ca02b2c69327 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:51.401326 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dd1639d6-00c9-41e2-9839-ca02b2c69327 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:51.401772 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dd1639d6-00c9-41e2-9839-ca02b2c69327 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:51.402583 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dd1639d6-00c9-41e2-9839-ca02b2c69327 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:51.403019 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dd1639d6-00c9-41e2-9839-ca02b2c69327 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:51.546950 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-dd1639d6-00c9-41e2-9839-ca02b2c69327 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:51.557005 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-dd1639d6-00c9-41e2-9839-ca02b2c69327 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1653 microversion: 2.1 time: 0.165918 Jan 18 20:26:51.567865 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 289/583] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:51 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1653 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:51.575435 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a29742a8-8e0e-4900-8b26-65457235c690 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:26:51.582185 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a29742a8-8e0e-4900-8b26-65457235c690 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:51.582766 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a29742a8-8e0e-4900-8b26-65457235c690 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:51.607158 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a29742a8-8e0e-4900-8b26-65457235c690 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Going to try to start instance {{(pid=116375) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 18 20:26:51.653665 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a29742a8-8e0e-4900-8b26-65457235c690 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action" status: 202 len: 0 microversion: 2.1 time: 0.081561 Jan 18 20:26:51.654512 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 295/584] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:26:51 2022] POST /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:26:51.663427 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0e402909-1f29-4b64-95be-75326cf38cc9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:51.669343 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0e402909-1f29-4b64-95be-75326cf38cc9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:51.680672 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0e402909-1f29-4b64-95be-75326cf38cc9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:51.681542 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0e402909-1f29-4b64-95be-75326cf38cc9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:51.682852 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0e402909-1f29-4b64-95be-75326cf38cc9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:51.683857 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0e402909-1f29-4b64-95be-75326cf38cc9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:51.873055 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-0e402909-1f29-4b64-95be-75326cf38cc9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:51.885420 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0e402909-1f29-4b64-95be-75326cf38cc9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1662 microversion: 2.1 time: 0.224710 Jan 18 20:26:51.886445 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 290/585] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:51 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1662 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:52.904721 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-763b7f59-e397-4404-b728-67a1648c67c9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:52.905444 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-763b7f59-e397-4404-b728-67a1648c67c9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:52.912049 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-763b7f59-e397-4404-b728-67a1648c67c9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:52.912494 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-763b7f59-e397-4404-b728-67a1648c67c9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:52.913278 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-763b7f59-e397-4404-b728-67a1648c67c9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:52.913714 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-763b7f59-e397-4404-b728-67a1648c67c9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:53.077252 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-763b7f59-e397-4404-b728-67a1648c67c9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:53.084514 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-763b7f59-e397-4404-b728-67a1648c67c9 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1662 microversion: 2.1 time: 0.184356 Jan 18 20:26:53.085069 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 296/586] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:52 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1662 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:54.101910 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-14578c75-bc1b-4055-8623-f71e262f3341 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:54.102521 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-14578c75-bc1b-4055-8623-f71e262f3341 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:54.109475 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-14578c75-bc1b-4055-8623-f71e262f3341 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:54.109861 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-14578c75-bc1b-4055-8623-f71e262f3341 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:54.110639 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-14578c75-bc1b-4055-8623-f71e262f3341 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:54.111104 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-14578c75-bc1b-4055-8623-f71e262f3341 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:54.236915 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-14578c75-bc1b-4055-8623-f71e262f3341 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:54.244328 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-14578c75-bc1b-4055-8623-f71e262f3341 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1662 microversion: 2.1 time: 0.146020 Jan 18 20:26:54.244894 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 291/587] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:54 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1662 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:55.261735 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-36004e07-d1a4-4780-a57e-8c3a3a062264 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:55.262271 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-36004e07-d1a4-4780-a57e-8c3a3a062264 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:55.269183 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-36004e07-d1a4-4780-a57e-8c3a3a062264 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:55.269646 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-36004e07-d1a4-4780-a57e-8c3a3a062264 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:55.270407 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-36004e07-d1a4-4780-a57e-8c3a3a062264 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:55.270841 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-36004e07-d1a4-4780-a57e-8c3a3a062264 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:55.404022 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-36004e07-d1a4-4780-a57e-8c3a3a062264 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:55.411902 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-36004e07-d1a4-4780-a57e-8c3a3a062264 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1662 microversion: 2.1 time: 0.153973 Jan 18 20:26:55.412459 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 297/588] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:55 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:26:56.429226 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-80fbd317-2a11-451b-a401-24453051a8b1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:26:56.429851 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-80fbd317-2a11-451b-a401-24453051a8b1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:26:56.436105 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-80fbd317-2a11-451b-a401-24453051a8b1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:56.436543 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-80fbd317-2a11-451b-a401-24453051a8b1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:56.437305 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-80fbd317-2a11-451b-a401-24453051a8b1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:26:56.437731 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-80fbd317-2a11-451b-a401-24453051a8b1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:26:56.567348 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-80fbd317-2a11-451b-a401-24453051a8b1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:26:56.575132 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-80fbd317-2a11-451b-a401-24453051a8b1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1666 microversion: 2.1 time: 0.149419 Jan 18 20:26:56.575710 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 292/589] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:26:56 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:16.157658 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-96594029-e5f2-4ed5-a2e1-59d3ff019ae0 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Action: 'create', calling method: .version_select at 0x7f1782dd4c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1147709869"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:16.172257 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-96594029-e5f2-4ed5-a2e1-59d3ff019ae0 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Getting quotas for project 32060f3477d348b7bb92a2240bec099f. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:27:16.176866 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-96594029-e5f2-4ed5-a2e1-59d3ff019ae0 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Getting quotas for user 41ed9ec315254412868a0b323e8dad59 and project 32060f3477d348b7bb92a2240bec099f. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:27:16.323516 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-96594029-e5f2-4ed5-a2e1-59d3ff019ae0 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Getting quotas for project 32060f3477d348b7bb92a2240bec099f. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:27:16.331915 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-96594029-e5f2-4ed5-a2e1-59d3ff019ae0 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Getting quotas for user 41ed9ec315254412868a0b323e8dad59 and project 32060f3477d348b7bb92a2240bec099f. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:27:16.349718 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-96594029-e5f2-4ed5-a2e1-59d3ff019ae0 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.436065 Jan 18 20:27:16.355398 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 298/590] 10.222.0.67 () {60 vars in 1157 bytes} [Tue Jan 18 20:27:15 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:20.115020 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a62fe50f-f47c-4f87-8f2a-f787e41b1a2e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:20.115616 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-a62fe50f-f47c-4f87-8f2a-f787e41b1a2e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:20.123747 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a62fe50f-f47c-4f87-8f2a-f787e41b1a2e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:20.124192 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a62fe50f-f47c-4f87-8f2a-f787e41b1a2e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:20.125008 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a62fe50f-f47c-4f87-8f2a-f787e41b1a2e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:20.125448 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a62fe50f-f47c-4f87-8f2a-f787e41b1a2e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:20.157356 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a62fe50f-f47c-4f87-8f2a-f787e41b1a2e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/os-volume_attachments/1d1e23cd-216f-4ae9-91d4-125828b02036" status: 200 len: 194 microversion: 2.20 time: 0.046065 Jan 18 20:27:20.157956 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 293/591] 10.222.0.67 () {60 vars in 1453 bytes} [Tue Jan 18 20:27:20 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/os-volume_attachments/1d1e23cd-216f-4ae9-91d4-125828b02036 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:27:20.226969 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-112f9423-cc64-402e-8745-597c6b116106 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:20.227630 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-112f9423-cc64-402e-8745-597c6b116106 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:20.234671 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-112f9423-cc64-402e-8745-597c6b116106 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:20.235153 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-112f9423-cc64-402e-8745-597c6b116106 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:20.235946 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-112f9423-cc64-402e-8745-597c6b116106 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:20.236379 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-112f9423-cc64-402e-8745-597c6b116106 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:20.327411 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-112f9423-cc64-402e-8745-597c6b116106 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lazy-loading 'services' on Instance uuid 54f16911-8813-49b1-a940-9d83c6a5b131 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:27:20.424185 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-112f9423-cc64-402e-8745-597c6b116106 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "DELETE /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/os-volume_attachments/1d1e23cd-216f-4ae9-91d4-125828b02036" status: 202 len: 0 microversion: 2.20 time: 0.201581 Jan 18 20:27:20.425089 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 299/592] 10.222.0.67 () {60 vars in 1456 bytes} [Tue Jan 18 20:27:20 2022] DELETE /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/os-volume_attachments/1d1e23cd-216f-4ae9-91d4-125828b02036 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:27:20.434337 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-20faff7e-f242-49b3-8f02-897a9c879321 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:20.435424 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-20faff7e-f242-49b3-8f02-897a9c879321 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:20.442146 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-20faff7e-f242-49b3-8f02-897a9c879321 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:20.442652 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-20faff7e-f242-49b3-8f02-897a9c879321 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:20.443587 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-20faff7e-f242-49b3-8f02-897a9c879321 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:20.444093 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-20faff7e-f242-49b3-8f02-897a9c879321 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:20.479758 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-20faff7e-f242-49b3-8f02-897a9c879321 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049596 Jan 18 20:27:20.480482 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 294/593] 10.222.0.67 () {60 vars in 1342 bytes} [Tue Jan 18 20:27:20 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:27:21.493024 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-31cc7b5b-3368-4c98-8e36-193f18e78f23 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:21.494103 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-31cc7b5b-3368-4c98-8e36-193f18e78f23 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:21.505288 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-31cc7b5b-3368-4c98-8e36-193f18e78f23 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:21.505733 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-31cc7b5b-3368-4c98-8e36-193f18e78f23 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:21.506527 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-31cc7b5b-3368-4c98-8e36-193f18e78f23 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:21.506959 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-31cc7b5b-3368-4c98-8e36-193f18e78f23 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:21.538542 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-31cc7b5b-3368-4c98-8e36-193f18e78f23 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050049 Jan 18 20:27:21.539174 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 300/594] 10.222.0.67 () {60 vars in 1342 bytes} [Tue Jan 18 20:27:21 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:21.595002 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-944333c9-d9de-4b4d-8141-b504b50a3091 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:21.595551 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-944333c9-d9de-4b4d-8141-b504b50a3091 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:21.601911 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-944333c9-d9de-4b4d-8141-b504b50a3091 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:21.602360 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-944333c9-d9de-4b4d-8141-b504b50a3091 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:21.603187 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-944333c9-d9de-4b4d-8141-b504b50a3091 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:21.603627 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-944333c9-d9de-4b4d-8141-b504b50a3091 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:21.628895 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-944333c9-d9de-4b4d-8141-b504b50a3091 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Going to try to terminate instance {{(pid=116376) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:27:21.703714 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-944333c9-d9de-4b4d-8141-b504b50a3091 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "DELETE /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 204 len: 0 microversion: 2.20 time: 0.112623 Jan 18 20:27:21.704211 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 295/595] 10.222.0.67 () {60 vars in 1279 bytes} [Tue Jan 18 20:27:21 2022] DELETE /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 18 20:27:21.712416 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-91913d30-429b-4ad2-807e-9f5eca3a959c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:21.713012 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-91913d30-429b-4ad2-807e-9f5eca3a959c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:21.719375 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-91913d30-429b-4ad2-807e-9f5eca3a959c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:21.719819 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-91913d30-429b-4ad2-807e-9f5eca3a959c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:21.720759 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-91913d30-429b-4ad2-807e-9f5eca3a959c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:21.721185 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-91913d30-429b-4ad2-807e-9f5eca3a959c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:21.852713 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-91913d30-429b-4ad2-807e-9f5eca3a959c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:21.860791 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-91913d30-429b-4ad2-807e-9f5eca3a959c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:21.862280 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-91913d30-429b-4ad2-807e-9f5eca3a959c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:21.863444 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-91913d30-429b-4ad2-807e-9f5eca3a959c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.154817 Jan 18 20:27:21.863988 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 301/596] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:27:21 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:27:22.882272 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-2131e257-8f3a-49ad-b449-4adf83dde86b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:22.883061 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-2131e257-8f3a-49ad-b449-4adf83dde86b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:22.892500 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2131e257-8f3a-49ad-b449-4adf83dde86b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:22.893652 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2131e257-8f3a-49ad-b449-4adf83dde86b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:22.901114 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2131e257-8f3a-49ad-b449-4adf83dde86b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:22.904619 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2131e257-8f3a-49ad-b449-4adf83dde86b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:23.047525 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-2131e257-8f3a-49ad-b449-4adf83dde86b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:23.056702 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-2131e257-8f3a-49ad-b449-4adf83dde86b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:23.058202 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-2131e257-8f3a-49ad-b449-4adf83dde86b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:23.059375 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2131e257-8f3a-49ad-b449-4adf83dde86b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.181364 Jan 18 20:27:23.059936 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 296/597] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:27:22 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:27:24.077379 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8fe6f5db-3c86-462b-a743-1ad4f5b5bf76 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:24.077992 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8fe6f5db-3c86-462b-a743-1ad4f5b5bf76 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:24.084475 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8fe6f5db-3c86-462b-a743-1ad4f5b5bf76 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:24.085128 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8fe6f5db-3c86-462b-a743-1ad4f5b5bf76 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:24.086010 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8fe6f5db-3c86-462b-a743-1ad4f5b5bf76 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:24.086455 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8fe6f5db-3c86-462b-a743-1ad4f5b5bf76 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:24.306024 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8fe6f5db-3c86-462b-a743-1ad4f5b5bf76 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:24.314187 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8fe6f5db-3c86-462b-a743-1ad4f5b5bf76 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:24.315725 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8fe6f5db-3c86-462b-a743-1ad4f5b5bf76 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:24.317145 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8fe6f5db-3c86-462b-a743-1ad4f5b5bf76 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 200 len: 1722 microversion: 2.20 time: 0.243669 Jan 18 20:27:24.317712 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 302/598] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:27:24 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:27:24.709308 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-99200b29-223b-4d51-b50d-09001b7faa49 req-f55f3d02-9f86-4b95-a72f-fd81443975d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54f16911-8813-49b1-a940-9d83c6a5b131", "name": "network-vif-deleted", "tag": "555e1e24-9775-40bc-b590-9ec8763d4dd0"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:24.712650 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:27:24.712650 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:27:24.721724 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-99200b29-223b-4d51-b50d-09001b7faa49 req-f55f3d02-9f86-4b95-a72f-fd81443975d1 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:24.722559 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-99200b29-223b-4d51-b50d-09001b7faa49 req-f55f3d02-9f86-4b95-a72f-fd81443975d1 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:24.738921 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-99200b29-223b-4d51-b50d-09001b7faa49 req-f55f3d02-9f86-4b95-a72f-fd81443975d1 service nova] Creating event network-vif-deleted:555e1e24-9775-40bc-b590-9ec8763d4dd0 for instance 54f16911-8813-49b1-a940-9d83c6a5b131 on hv-cinder-82160 Jan 18 20:27:24.746999 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-99200b29-223b-4d51-b50d-09001b7faa49 req-f55f3d02-9f86-4b95-a72f-fd81443975d1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041813 Jan 18 20:27:24.752211 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 297/599] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:27:25.336944 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a9b7ba51-e27c-4e93-8d29-a2462cd53b38 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:25.337566 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a9b7ba51-e27c-4e93-8d29-a2462cd53b38 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:25.344761 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a9b7ba51-e27c-4e93-8d29-a2462cd53b38 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:25.345206 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a9b7ba51-e27c-4e93-8d29-a2462cd53b38 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:25.345990 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a9b7ba51-e27c-4e93-8d29-a2462cd53b38 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:25.348861 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a9b7ba51-e27c-4e93-8d29-a2462cd53b38 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:25.377148 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-a9b7ba51-e27c-4e93-8d29-a2462cd53b38 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] HTTP exception thrown: Instance 54f16911-8813-49b1-a940-9d83c6a5b131 could not be found. Jan 18 20:27:25.378018 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a9b7ba51-e27c-4e93-8d29-a2462cd53b38 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Returning 404 to user: Instance 54f16911-8813-49b1-a940-9d83c6a5b131 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:27:25.379063 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a9b7ba51-e27c-4e93-8d29-a2462cd53b38 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 404 len: 111 microversion: 2.20 time: 0.046031 Jan 18 20:27:25.379663 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 303/600] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:27:25 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 18 20:27:25.388488 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-79caf1e6-ec06-4395-b909-11c2a562e8de tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '.version_select at 0x7f1782e774c0>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:25.418106 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-79caf1e6-ec06-4395-b909-11c2a562e8de tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-748024130" status: 204 len: 0 microversion: 2.20 time: 0.033540 Jan 18 20:27:25.419097 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 298/601] 10.222.0.67 () {60 vars in 1258 bytes} [Tue Jan 18 20:27:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-748024130 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 18 20:27:26.378811 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f38f911e-b34b-4f08-b797-7fc8ddb338ce tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'create', calling method: .version_select at 0x7f1782e330d0>, body: {"keypair": {"name": "tempest-keypair-1590711183"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:26.398422 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-f38f911e-b34b-4f08-b797-7fc8ddb338ce tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Getting quotas for project 9d6dd542180144d480be34c9a555ae63. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:27:26.403407 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-f38f911e-b34b-4f08-b797-7fc8ddb338ce tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Getting quotas for user b40e1486b9184e25b89c064fb56673df and project 9d6dd542180144d480be34c9a555ae63. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:27:26.837647 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-f38f911e-b34b-4f08-b797-7fc8ddb338ce tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Getting quotas for project 9d6dd542180144d480be34c9a555ae63. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:27:26.842308 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-f38f911e-b34b-4f08-b797-7fc8ddb338ce tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Getting quotas for user b40e1486b9184e25b89c064fb56673df and project 9d6dd542180144d480be34c9a555ae63. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:27:26.870151 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f38f911e-b34b-4f08-b797-7fc8ddb338ce tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.488287 Jan 18 20:27:26.870151 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 304/602] 10.222.0.67 () {62 vars in 1198 bytes} [Tue Jan 18 20:27:26 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 490 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 18 20:27:28.376618 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4f455cc8-d891-4ca9-9eae-1021d2b22634 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-881116360", "imageRef": "c7d259ac-b206-430f-a3c0-794cee408236", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09a7462a-8def-4289-bb51-c535f8395ac3"}], "security_groups": [{"name": "tempest-securitygroup--589351673"}], "key_name": "tempest-keypair-1590711183", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:28.484559 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.network.neutron [None req-4f455cc8-d891-4ca9-9eae-1021d2b22634 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] validate_networks() for [('09a7462a-8def-4289-bb51-c535f8395ac3', None, None, None, None, None)] {{(pid=116376) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:27:28.872953 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-4f455cc8-d891-4ca9-9eae-1021d2b22634 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Flavor limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:27:28.873310 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-4f455cc8-d891-4ca9-9eae-1021d2b22634 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Image limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:27:28.873971 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-4f455cc8-d891-4ca9-9eae-1021d2b22634 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Flavor pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:27:28.874383 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-4f455cc8-d891-4ca9-9eae-1021d2b22634 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Image pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:27:28.874797 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-4f455cc8-d891-4ca9-9eae-1021d2b22634 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:27:28.883670 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4f455cc8-d891-4ca9-9eae-1021d2b22634 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:28.884131 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4f455cc8-d891-4ca9-9eae-1021d2b22634 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:28.884933 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4f455cc8-d891-4ca9-9eae-1021d2b22634 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:28.885540 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4f455cc8-d891-4ca9-9eae-1021d2b22634 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:28.902048 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-4f455cc8-d891-4ca9-9eae-1021d2b22634 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Getting quotas for project 9d6dd542180144d480be34c9a555ae63. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:27:28.906544 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-4f455cc8-d891-4ca9-9eae-1021d2b22634 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Getting quotas for user b40e1486b9184e25b89c064fb56673df and project 9d6dd542180144d480be34c9a555ae63. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:27:28.917354 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-4f455cc8-d891-4ca9-9eae-1021d2b22634 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Going to run 1 instances... {{(pid=116376) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:27:28.920375 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-4f455cc8-d891-4ca9-9eae-1021d2b22634 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7d259ac-b206-430f-a3c0-794cee408236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116376) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:27:28.977969 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-4f455cc8-d891-4ca9-9eae-1021d2b22634 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.606391 Jan 18 20:27:28.979316 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 299/603] 10.222.0.67 () {62 vars in 1187 bytes} [Tue Jan 18 20:27:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jan 18 20:27:28.998504 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-89f9d3b2-6bf7-46d3-8f54-936e3486b92e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:28.999808 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-89f9d3b2-6bf7-46d3-8f54-936e3486b92e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:29.064129 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-89f9d3b2-6bf7-46d3-8f54-936e3486b92e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:29.072716 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-89f9d3b2-6bf7-46d3-8f54-936e3486b92e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:29.074212 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-89f9d3b2-6bf7-46d3-8f54-936e3486b92e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:29.076179 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-89f9d3b2-6bf7-46d3-8f54-936e3486b92e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1281 microversion: 2.20 time: 0.085017 Jan 18 20:27:29.076804 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 305/604] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:27:28 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:27:30.096349 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d0f38281-8e5e-4c51-bc66-4768d8ca0ff1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:30.096950 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d0f38281-8e5e-4c51-bc66-4768d8ca0ff1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:30.103706 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d0f38281-8e5e-4c51-bc66-4768d8ca0ff1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:30.104150 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d0f38281-8e5e-4c51-bc66-4768d8ca0ff1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:30.104910 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d0f38281-8e5e-4c51-bc66-4768d8ca0ff1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:30.105337 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d0f38281-8e5e-4c51-bc66-4768d8ca0ff1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:30.173777 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d0f38281-8e5e-4c51-bc66-4768d8ca0ff1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:30.182138 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d0f38281-8e5e-4c51-bc66-4768d8ca0ff1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:30.183681 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d0f38281-8e5e-4c51-bc66-4768d8ca0ff1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:30.184778 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d0f38281-8e5e-4c51-bc66-4768d8ca0ff1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1285 microversion: 2.20 time: 0.092730 Jan 18 20:27:30.185938 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 300/605] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:27:30 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:27:31.203910 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-af29478c-49d9-426b-8458-3941c489c72b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:31.204926 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-af29478c-49d9-426b-8458-3941c489c72b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:31.211471 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-af29478c-49d9-426b-8458-3941c489c72b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:31.211849 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-af29478c-49d9-426b-8458-3941c489c72b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:31.212636 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-af29478c-49d9-426b-8458-3941c489c72b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:31.213075 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-af29478c-49d9-426b-8458-3941c489c72b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:31.289176 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-af29478c-49d9-426b-8458-3941c489c72b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:31.299517 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-af29478c-49d9-426b-8458-3941c489c72b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:31.301818 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-af29478c-49d9-426b-8458-3941c489c72b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:31.303391 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-af29478c-49d9-426b-8458-3941c489c72b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1339 microversion: 2.20 time: 0.103792 Jan 18 20:27:31.304527 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 306/606] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:27:31 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1339 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:27:32.334130 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f49e1b11-f4b5-4c9b-94c9-99a0ab36b8a2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:32.335644 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-f49e1b11-f4b5-4c9b-94c9-99a0ab36b8a2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:32.344271 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f49e1b11-f4b5-4c9b-94c9-99a0ab36b8a2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:32.345125 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f49e1b11-f4b5-4c9b-94c9-99a0ab36b8a2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:32.346192 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f49e1b11-f4b5-4c9b-94c9-99a0ab36b8a2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:32.347322 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f49e1b11-f4b5-4c9b-94c9-99a0ab36b8a2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:32.516853 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-f49e1b11-f4b5-4c9b-94c9-99a0ab36b8a2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:32.524872 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-f49e1b11-f4b5-4c9b-94c9-99a0ab36b8a2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:32.526394 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-f49e1b11-f4b5-4c9b-94c9-99a0ab36b8a2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:32.527537 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-f49e1b11-f4b5-4c9b-94c9-99a0ab36b8a2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1406 microversion: 2.20 time: 0.199027 Jan 18 20:27:32.537848 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 301/607] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:27:32 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:27:32.554401 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-797897ed-74b0-4f1d-b258-17c265894055 req-8de832eb-d463-4de6-9200-aaf340bb618a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6d0afa1-510c-4954-8984-662702bb00dc", "tag": "40086b9f-1a65-40f2-9db4-6bf22c7ecd7d"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:32.556190 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:27:32.556190 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:27:32.577917 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-797897ed-74b0-4f1d-b258-17c265894055 req-8de832eb-d463-4de6-9200-aaf340bb618a service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:32.580146 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-797897ed-74b0-4f1d-b258-17c265894055 req-8de832eb-d463-4de6-9200-aaf340bb618a service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:32.597488 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-797897ed-74b0-4f1d-b258-17c265894055 req-8de832eb-d463-4de6-9200-aaf340bb618a service nova] Creating event network-changed:40086b9f-1a65-40f2-9db4-6bf22c7ecd7d for instance c6d0afa1-510c-4954-8984-662702bb00dc on hv-cinder-82160 Jan 18 20:27:32.603721 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-797897ed-74b0-4f1d-b258-17c265894055 req-8de832eb-d463-4de6-9200-aaf340bb618a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053618 Jan 18 20:27:32.605752 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 307/608] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:27:33.545835 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5b20336c-6596-4c27-afb6-9df26ec64972 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:33.546856 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-5b20336c-6596-4c27-afb6-9df26ec64972 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:33.553927 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5b20336c-6596-4c27-afb6-9df26ec64972 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:33.554378 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5b20336c-6596-4c27-afb6-9df26ec64972 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:33.555208 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5b20336c-6596-4c27-afb6-9df26ec64972 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:33.555646 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5b20336c-6596-4c27-afb6-9df26ec64972 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:33.687054 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-5b20336c-6596-4c27-afb6-9df26ec64972 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:33.694782 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-5b20336c-6596-4c27-afb6-9df26ec64972 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:33.696314 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-5b20336c-6596-4c27-afb6-9df26ec64972 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:33.697437 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-5b20336c-6596-4c27-afb6-9df26ec64972 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1406 microversion: 2.20 time: 0.156113 Jan 18 20:27:33.697994 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 302/609] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:27:33 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:27:34.175202 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-189b1fbb-a791-416e-8bc6-98d315f58bac tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1096071631", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1147709869", "security_groups": [{"name": "tempest-secgroup-smoke-633455107"}], "networks": [{"uuid": "5f1d2458-30aa-44ca-b2e2-990d8ff94955"}], "block_device_mapping_v2": [{"uuid": "7276bb7f-23f0-4694-918c-9dcf85395d54", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:34.302507 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-189b1fbb-a791-416e-8bc6-98d315f58bac tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] validate_networks() for [('5f1d2458-30aa-44ca-b2e2-990d8ff94955', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:27:34.694566 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-189b1fbb-a791-416e-8bc6-98d315f58bac tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:27:34.695316 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-189b1fbb-a791-416e-8bc6-98d315f58bac tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:27:34.695955 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-189b1fbb-a791-416e-8bc6-98d315f58bac tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:27:34.696669 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-189b1fbb-a791-416e-8bc6-98d315f58bac tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:27:34.697286 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-189b1fbb-a791-416e-8bc6-98d315f58bac tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:27:34.707629 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-189b1fbb-a791-416e-8bc6-98d315f58bac tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:34.708109 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-189b1fbb-a791-416e-8bc6-98d315f58bac tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:34.708918 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-189b1fbb-a791-416e-8bc6-98d315f58bac tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:34.709356 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-189b1fbb-a791-416e-8bc6-98d315f58bac tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:34.715464 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4ad68920-f97b-43c1-8946-8b949f0fe126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:34.717192 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-4ad68920-f97b-43c1-8946-8b949f0fe126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:34.724280 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4ad68920-f97b-43c1-8946-8b949f0fe126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:34.724738 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4ad68920-f97b-43c1-8946-8b949f0fe126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:34.725531 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4ad68920-f97b-43c1-8946-8b949f0fe126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:34.725965 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4ad68920-f97b-43c1-8946-8b949f0fe126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:34.728139 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-189b1fbb-a791-416e-8bc6-98d315f58bac tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Getting quotas for project 32060f3477d348b7bb92a2240bec099f. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:27:34.733172 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-189b1fbb-a791-416e-8bc6-98d315f58bac tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Getting quotas for user 41ed9ec315254412868a0b323e8dad59 and project 32060f3477d348b7bb92a2240bec099f. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:27:34.790439 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-189b1fbb-a791-416e-8bc6-98d315f58bac tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:27:34.792799 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-189b1fbb-a791-416e-8bc6-98d315f58bac tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7276bb7f-23f0-4694-918c-9dcf85395d54',volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:27:34.863998 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-4ad68920-f97b-43c1-8946-8b949f0fe126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:34.872100 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-4ad68920-f97b-43c1-8946-8b949f0fe126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:34.873711 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-4ad68920-f97b-43c1-8946-8b949f0fe126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:34.874937 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-4ad68920-f97b-43c1-8946-8b949f0fe126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1406 microversion: 2.20 time: 0.163162 Jan 18 20:27:34.875594 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 303/610] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:27:34 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:27:34.922668 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-189b1fbb-a791-416e-8bc6-98d315f58bac tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.751535 Jan 18 20:27:34.927227 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 308/611] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:27:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 20:27:34.933623 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-74c1d93a-2b34-42d8-a839-c914b36f9e44 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:34.934260 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-74c1d93a-2b34-42d8-a839-c914b36f9e44 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:34.987186 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-74c1d93a-2b34-42d8-a839-c914b36f9e44 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:34.993564 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-74c1d93a-2b34-42d8-a839-c914b36f9e44 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1089 microversion: 2.1 time: 0.063934 Jan 18 20:27:34.994124 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 304/612] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:34 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1089 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:27:35.646508 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9f474096-4cc8-4cb9-8192-3ac6b509d502 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:35.647527 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9f474096-4cc8-4cb9-8192-3ac6b509d502 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:35.654200 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f474096-4cc8-4cb9-8192-3ac6b509d502 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:35.654650 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f474096-4cc8-4cb9-8192-3ac6b509d502 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:35.655471 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f474096-4cc8-4cb9-8192-3ac6b509d502 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:35.655910 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f474096-4cc8-4cb9-8192-3ac6b509d502 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:35.684315 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9f474096-4cc8-4cb9-8192-3ac6b509d502 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041755 Jan 18 20:27:35.685282 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 309/613] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:27:35 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:27:35.746928 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-8fa09290-663f-4c49-adf7-48afae65ea17 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:35.748062 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-8fa09290-663f-4c49-adf7-48afae65ea17 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:35.754741 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8fa09290-663f-4c49-adf7-48afae65ea17 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:35.755296 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8fa09290-663f-4c49-adf7-48afae65ea17 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:35.756190 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8fa09290-663f-4c49-adf7-48afae65ea17 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:35.756738 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8fa09290-663f-4c49-adf7-48afae65ea17 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:35.785841 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-8fa09290-663f-4c49-adf7-48afae65ea17 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Going to try to terminate instance {{(pid=116376) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:27:35.895262 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d6aa445f-68e8-4802-8291-e34e6db1817f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:35.896569 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d6aa445f-68e8-4802-8291-e34e6db1817f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:35.906784 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d6aa445f-68e8-4802-8291-e34e6db1817f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:35.907498 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d6aa445f-68e8-4802-8291-e34e6db1817f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:35.908676 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d6aa445f-68e8-4802-8291-e34e6db1817f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:35.909839 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d6aa445f-68e8-4802-8291-e34e6db1817f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:35.910976 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-8fa09290-663f-4c49-adf7-48afae65ea17 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 204 len: 0 microversion: 2.1 time: 0.166506 Jan 18 20:27:35.912209 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 305/614] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:27:35 2022] DELETE /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:27:35.924086 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-9f46200d-44fa-4e42-93b2-76cfaf5c4a84 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:35.925102 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-9f46200d-44fa-4e42-93b2-76cfaf5c4a84 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:35.932619 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9f46200d-44fa-4e42-93b2-76cfaf5c4a84 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:35.933410 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9f46200d-44fa-4e42-93b2-76cfaf5c4a84 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:35.934400 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9f46200d-44fa-4e42-93b2-76cfaf5c4a84 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:35.935616 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9f46200d-44fa-4e42-93b2-76cfaf5c4a84 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:36.123931 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-9f46200d-44fa-4e42-93b2-76cfaf5c4a84 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:36.132865 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-9f46200d-44fa-4e42-93b2-76cfaf5c4a84 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1672 microversion: 2.1 time: 0.215854 Jan 18 20:27:36.134119 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 306/615] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:35 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1672 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:27:36.137230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d6aa445f-68e8-4802-8291-e34e6db1817f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:36.139323 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4b12b541-ad6f-4459-bc68-3746e0e8103c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:36.140253 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-4b12b541-ad6f-4459-bc68-3746e0e8103c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:36.146937 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d6aa445f-68e8-4802-8291-e34e6db1817f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:36.147224 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4b12b541-ad6f-4459-bc68-3746e0e8103c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:36.147726 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4b12b541-ad6f-4459-bc68-3746e0e8103c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:36.148451 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d6aa445f-68e8-4802-8291-e34e6db1817f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:36.148708 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4b12b541-ad6f-4459-bc68-3746e0e8103c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:36.149614 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4b12b541-ad6f-4459-bc68-3746e0e8103c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:36.149745 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d6aa445f-68e8-4802-8291-e34e6db1817f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1406 microversion: 2.20 time: 0.261681 Jan 18 20:27:36.150389 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 310/616] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:27:35 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:27:36.220741 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-4b12b541-ad6f-4459-bc68-3746e0e8103c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:36.228946 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-4b12b541-ad6f-4459-bc68-3746e0e8103c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1205 microversion: 2.1 time: 0.093417 Jan 18 20:27:36.229746 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 307/617] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:36 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1205 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:37.150769 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b33be104-7bb5-472e-938b-955fee8c99d1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:37.152771 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b33be104-7bb5-472e-938b-955fee8c99d1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:37.159719 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b33be104-7bb5-472e-938b-955fee8c99d1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:37.160382 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b33be104-7bb5-472e-938b-955fee8c99d1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:37.161174 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b33be104-7bb5-472e-938b-955fee8c99d1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:37.161785 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b33be104-7bb5-472e-938b-955fee8c99d1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:37.166997 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-33021cdb-1202-4700-8067-dd9947f17e7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:37.167633 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-33021cdb-1202-4700-8067-dd9947f17e7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:37.174474 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-33021cdb-1202-4700-8067-dd9947f17e7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:37.174930 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-33021cdb-1202-4700-8067-dd9947f17e7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:37.175742 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-33021cdb-1202-4700-8067-dd9947f17e7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:37.176987 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-33021cdb-1202-4700-8067-dd9947f17e7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:37.335897 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-33021cdb-1202-4700-8067-dd9947f17e7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:37.350363 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-33021cdb-1202-4700-8067-dd9947f17e7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:37.353036 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-33021cdb-1202-4700-8067-dd9947f17e7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:37.354703 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-33021cdb-1202-4700-8067-dd9947f17e7e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1406 microversion: 2.20 time: 0.191353 Jan 18 20:27:37.355527 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 308/618] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:27:37 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:27:37.372865 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-c304bfb6-1acc-4ad0-b732-fe32190f1ac9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:37.373945 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-c304bfb6-1acc-4ad0-b732-fe32190f1ac9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:37.381399 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c304bfb6-1acc-4ad0-b732-fe32190f1ac9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:37.381936 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c304bfb6-1acc-4ad0-b732-fe32190f1ac9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:37.382951 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c304bfb6-1acc-4ad0-b732-fe32190f1ac9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:37.383567 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c304bfb6-1acc-4ad0-b732-fe32190f1ac9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:37.490081 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b33be104-7bb5-472e-938b-955fee8c99d1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:37.499179 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b33be104-7bb5-472e-938b-955fee8c99d1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1672 microversion: 2.1 time: 0.352049 Jan 18 20:27:37.507141 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 311/619] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:37 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1672 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:37.524664 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-c304bfb6-1acc-4ad0-b732-fe32190f1ac9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:37.532468 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-c304bfb6-1acc-4ad0-b732-fe32190f1ac9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1260 microversion: 2.1 time: 0.165009 Jan 18 20:27:37.533049 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 309/620] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:37 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:37.889440 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-3fda4a32-0f1b-4133-a05c-9a34a7dad0f1 req-0af9eb1a-889c-4a6c-b62d-a7187a9fedb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3922fa1-08be-4eee-9088-5ccf7cf4014e", "tag": "f1f716af-ae09-4a01-8a29-d7bb8bff9321"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:37.891637 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:27:37.891637 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:27:37.904804 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-3fda4a32-0f1b-4133-a05c-9a34a7dad0f1 req-0af9eb1a-889c-4a6c-b62d-a7187a9fedb1 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:37.905472 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-3fda4a32-0f1b-4133-a05c-9a34a7dad0f1 req-0af9eb1a-889c-4a6c-b62d-a7187a9fedb1 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:37.928401 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-3fda4a32-0f1b-4133-a05c-9a34a7dad0f1 req-0af9eb1a-889c-4a6c-b62d-a7187a9fedb1 service nova] Creating event network-changed:f1f716af-ae09-4a01-8a29-d7bb8bff9321 for instance d3922fa1-08be-4eee-9088-5ccf7cf4014e on hv-cinder-82160 Jan 18 20:27:37.935394 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-3fda4a32-0f1b-4133-a05c-9a34a7dad0f1 req-0af9eb1a-889c-4a6c-b62d-a7187a9fedb1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050039 Jan 18 20:27:37.936994 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 312/621] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:27:38.373508 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d074090c-2565-4d36-a41e-35e762a41c47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:38.374901 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d074090c-2565-4d36-a41e-35e762a41c47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:38.384627 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d074090c-2565-4d36-a41e-35e762a41c47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:38.385101 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d074090c-2565-4d36-a41e-35e762a41c47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:38.385912 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d074090c-2565-4d36-a41e-35e762a41c47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:38.386525 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d074090c-2565-4d36-a41e-35e762a41c47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:38.518181 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5aa993ca-948d-4b08-90cc-d890c1c17c2d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:38.518907 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5aa993ca-948d-4b08-90cc-d890c1c17c2d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:38.527141 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5aa993ca-948d-4b08-90cc-d890c1c17c2d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:38.527816 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5aa993ca-948d-4b08-90cc-d890c1c17c2d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:38.530011 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5aa993ca-948d-4b08-90cc-d890c1c17c2d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:38.531238 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5aa993ca-948d-4b08-90cc-d890c1c17c2d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:38.632983 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d074090c-2565-4d36-a41e-35e762a41c47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:38.643300 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d074090c-2565-4d36-a41e-35e762a41c47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:38.644086 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5aa993ca-948d-4b08-90cc-d890c1c17c2d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:38.645346 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d074090c-2565-4d36-a41e-35e762a41c47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:38.648348 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d074090c-2565-4d36-a41e-35e762a41c47 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1406 microversion: 2.20 time: 0.278723 Jan 18 20:27:38.649949 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 310/622] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:27:38 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:27:38.657575 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5aa993ca-948d-4b08-90cc-d890c1c17c2d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 200 len: 1605 microversion: 2.1 time: 0.144145 Jan 18 20:27:38.658159 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 313/623] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:38 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 1605 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:27:38.662560 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f9e6a897-de36-4838-9f69-750fe8ab744a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:38.663322 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-f9e6a897-de36-4838-9f69-750fe8ab744a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:38.673635 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f9e6a897-de36-4838-9f69-750fe8ab744a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:38.674148 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f9e6a897-de36-4838-9f69-750fe8ab744a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:38.675215 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f9e6a897-de36-4838-9f69-750fe8ab744a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:38.675856 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f9e6a897-de36-4838-9f69-750fe8ab744a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:38.918353 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-f9e6a897-de36-4838-9f69-750fe8ab744a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:38.932191 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-f9e6a897-de36-4838-9f69-750fe8ab744a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1260 microversion: 2.1 time: 0.281076 Jan 18 20:27:38.935223 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 311/624] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:38 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1260 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:38.946284 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-b53ad679-4965-4eec-bb57-a8821a13154c req-be3af4ea-1fa2-4b52-af3d-d468045661c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d0afa1-510c-4954-8984-662702bb00dc", "name": "network-vif-plugged", "status": "completed", "tag": "40086b9f-1a65-40f2-9db4-6bf22c7ecd7d"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:38.948397 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:27:38.948397 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:27:38.957022 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-b53ad679-4965-4eec-bb57-a8821a13154c req-be3af4ea-1fa2-4b52-af3d-d468045661c8 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:38.957483 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-b53ad679-4965-4eec-bb57-a8821a13154c req-be3af4ea-1fa2-4b52-af3d-d468045661c8 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:38.971376 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-b53ad679-4965-4eec-bb57-a8821a13154c req-be3af4ea-1fa2-4b52-af3d-d468045661c8 service nova] Creating event network-vif-plugged:40086b9f-1a65-40f2-9db4-6bf22c7ecd7d for instance c6d0afa1-510c-4954-8984-662702bb00dc on hv-cinder-82160 Jan 18 20:27:38.979541 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-b53ad679-4965-4eec-bb57-a8821a13154c req-be3af4ea-1fa2-4b52-af3d-d468045661c8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047274 Jan 18 20:27:38.980815 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 314/625] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:27:39.667251 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-2bbce719-9ee3-4e5a-95fc-a17e5a72c2cf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:39.668130 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-2bbce719-9ee3-4e5a-95fc-a17e5a72c2cf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:39.676391 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2bbce719-9ee3-4e5a-95fc-a17e5a72c2cf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:39.676840 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2bbce719-9ee3-4e5a-95fc-a17e5a72c2cf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:39.677665 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2bbce719-9ee3-4e5a-95fc-a17e5a72c2cf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:39.678104 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2bbce719-9ee3-4e5a-95fc-a17e5a72c2cf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:39.678624 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e1b05abb-9857-4169-8d9e-c409661d4300 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:39.679452 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e1b05abb-9857-4169-8d9e-c409661d4300 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:39.689003 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e1b05abb-9857-4169-8d9e-c409661d4300 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:39.689454 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e1b05abb-9857-4169-8d9e-c409661d4300 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:39.690245 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e1b05abb-9857-4169-8d9e-c409661d4300 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:39.690679 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e1b05abb-9857-4169-8d9e-c409661d4300 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:39.705142 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-e1b05abb-9857-4169-8d9e-c409661d4300 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] HTTP exception thrown: Instance b6e08025-ad66-4921-8672-ab55c85cbfb4 could not be found. Jan 18 20:27:39.705901 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e1b05abb-9857-4169-8d9e-c409661d4300 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Returning 404 to user: Instance b6e08025-ad66-4921-8672-ab55c85cbfb4 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:27:39.706743 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e1b05abb-9857-4169-8d9e-c409661d4300 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 404 len: 111 microversion: 2.1 time: 0.034498 Jan 18 20:27:39.709819 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 315/626] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:39 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 18 20:27:39.716206 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-88e10dd9-542c-44b2-baf9-c2034616510d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '.version_select at 0x7f1782dc2700>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:39.736252 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-88e10dd9-542c-44b2-baf9-c2034616510d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268719309" status: 202 len: 0 microversion: 2.1 time: 0.024120 Jan 18 20:27:39.736790 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 316/627] 10.222.0.67 () {58 vars in 1220 bytes} [Tue Jan 18 20:27:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268719309 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:27:39.832931 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-2bbce719-9ee3-4e5a-95fc-a17e5a72c2cf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:39.848548 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-2bbce719-9ee3-4e5a-95fc-a17e5a72c2cf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:39.852769 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-2bbce719-9ee3-4e5a-95fc-a17e5a72c2cf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:39.854448 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2bbce719-9ee3-4e5a-95fc-a17e5a72c2cf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1406 microversion: 2.20 time: 0.191344 Jan 18 20:27:39.857145 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 312/628] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:27:39 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:27:39.951784 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9cbc4dd8-be98-4588-9069-04ff6203b38c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:39.952403 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9cbc4dd8-be98-4588-9069-04ff6203b38c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:39.962247 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9cbc4dd8-be98-4588-9069-04ff6203b38c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:39.962699 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9cbc4dd8-be98-4588-9069-04ff6203b38c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:39.963516 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9cbc4dd8-be98-4588-9069-04ff6203b38c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:39.964128 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9cbc4dd8-be98-4588-9069-04ff6203b38c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:39.965384 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-95957c5e-9ed4-413b-8b9b-f64b8fbc1adb req-7b78f40f-ae3a-433f-a753-ad25d5216ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6e08025-ad66-4921-8672-ab55c85cbfb4", "name": "network-vif-deleted", "tag": "df2b9969-bf44-42c9-86a4-02ad9e3ae1d7"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:39.967583 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:27:39.967583 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:27:39.975725 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-95957c5e-9ed4-413b-8b9b-f64b8fbc1adb req-7b78f40f-ae3a-433f-a753-ad25d5216ba8 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:39.976426 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-95957c5e-9ed4-413b-8b9b-f64b8fbc1adb req-7b78f40f-ae3a-433f-a753-ad25d5216ba8 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:39.991444 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-95957c5e-9ed4-413b-8b9b-f64b8fbc1adb req-7b78f40f-ae3a-433f-a753-ad25d5216ba8 service nova] Creating event network-vif-deleted:df2b9969-bf44-42c9-86a4-02ad9e3ae1d7 for instance b6e08025-ad66-4921-8672-ab55c85cbfb4 on hv-cinder-82160 Jan 18 20:27:39.996899 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-95957c5e-9ed4-413b-8b9b-f64b8fbc1adb req-7b78f40f-ae3a-433f-a753-ad25d5216ba8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035069 Jan 18 20:27:39.998103 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 313/629] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:27:40.127111 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9cbc4dd8-be98-4588-9069-04ff6203b38c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:40.136469 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9cbc4dd8-be98-4588-9069-04ff6203b38c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1260 microversion: 2.1 time: 0.188661 Jan 18 20:27:40.137284 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 317/630] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:39 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:40.475541 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-6bb35eb3-8ea0-494c-99ab-2305fb0b52a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'create', calling method: .version_select at 0x7f1782e50f70>, body: {"keypair": {"name": "tempest-keypair-1881757113"}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:40.489258 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-6bb35eb3-8ea0-494c-99ab-2305fb0b52a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Getting quotas for project 56295fd7b6c447b4a143879d64dd49da. Resources: {'key_pairs'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:27:40.493320 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-6bb35eb3-8ea0-494c-99ab-2305fb0b52a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Getting quotas for user 526b24d5cecf4e078cd5188062e959f6 and project 56295fd7b6c447b4a143879d64dd49da. Resources: {'key_pairs'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:27:40.877874 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-badadb1c-d14c-4230-be77-e4f56b6b5b4b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:40.878549 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-badadb1c-d14c-4230-be77-e4f56b6b5b4b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:40.894485 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-badadb1c-d14c-4230-be77-e4f56b6b5b4b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:40.895205 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-badadb1c-d14c-4230-be77-e4f56b6b5b4b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:40.896158 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-badadb1c-d14c-4230-be77-e4f56b6b5b4b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:40.896607 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-badadb1c-d14c-4230-be77-e4f56b6b5b4b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:40.932590 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-6bb35eb3-8ea0-494c-99ab-2305fb0b52a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Getting quotas for project 56295fd7b6c447b4a143879d64dd49da. Resources: {'key_pairs'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:27:40.937121 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-6bb35eb3-8ea0-494c-99ab-2305fb0b52a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Getting quotas for user 526b24d5cecf4e078cd5188062e959f6 and project 56295fd7b6c447b4a143879d64dd49da. Resources: {'key_pairs'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:27:40.958368 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-6bb35eb3-8ea0-494c-99ab-2305fb0b52a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.486787 Jan 18 20:27:40.959095 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 314/631] 10.222.0.67 () {60 vars in 1157 bytes} [Tue Jan 18 20:27:40 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:27:41.082292 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-badadb1c-d14c-4230-be77-e4f56b6b5b4b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:41.090263 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-badadb1c-d14c-4230-be77-e4f56b6b5b4b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:41.091989 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-badadb1c-d14c-4230-be77-e4f56b6b5b4b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:41.093104 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-badadb1c-d14c-4230-be77-e4f56b6b5b4b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1598 microversion: 2.20 time: 0.222453 Jan 18 20:27:41.093752 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 318/632] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:27:40 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1598 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:27:41.111556 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5ad0fc2a-6571-41e9-bf98-78eada24fce9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:41.112411 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-5ad0fc2a-6571-41e9-bf98-78eada24fce9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:41.119587 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5ad0fc2a-6571-41e9-bf98-78eada24fce9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:41.120172 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5ad0fc2a-6571-41e9-bf98-78eada24fce9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:41.121029 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5ad0fc2a-6571-41e9-bf98-78eada24fce9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:41.121616 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5ad0fc2a-6571-41e9-bf98-78eada24fce9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:41.154074 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5070904b-deed-4694-9f8c-acd46fa968b6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:41.154612 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5070904b-deed-4694-9f8c-acd46fa968b6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:41.164671 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5070904b-deed-4694-9f8c-acd46fa968b6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:41.165341 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5070904b-deed-4694-9f8c-acd46fa968b6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:41.166368 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5070904b-deed-4694-9f8c-acd46fa968b6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:41.167074 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5070904b-deed-4694-9f8c-acd46fa968b6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:41.250330 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-5ad0fc2a-6571-41e9-bf98-78eada24fce9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.142514 Jan 18 20:27:41.251387 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 315/633] 10.222.0.67 () {60 vars in 1315 bytes} [Tue Jan 18 20:27:41 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:27:41.379268 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5070904b-deed-4694-9f8c-acd46fa968b6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:41.390935 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5070904b-deed-4694-9f8c-acd46fa968b6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1260 microversion: 2.1 time: 0.240534 Jan 18 20:27:41.391990 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 319/634] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:41 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:27:42.352831 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-16688ce0-785d-4766-bdd2-ee68c199765a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:42.353755 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-16688ce0-785d-4766-bdd2-ee68c199765a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:42.360786 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-16688ce0-785d-4766-bdd2-ee68c199765a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:42.361134 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-16688ce0-785d-4766-bdd2-ee68c199765a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:42.361919 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-16688ce0-785d-4766-bdd2-ee68c199765a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:42.362344 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-16688ce0-785d-4766-bdd2-ee68c199765a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:42.362541 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-3b188e56-0a7f-4c3b-84c0-2e9fa34a9da3 req-7ca6f75f-5b25-4267-99de-689d8b5cb243 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6d0afa1-510c-4954-8984-662702bb00dc", "tag": "40086b9f-1a65-40f2-9db4-6bf22c7ecd7d"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:42.364165 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:27:42.364165 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:27:42.373419 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-3b188e56-0a7f-4c3b-84c0-2e9fa34a9da3 req-7ca6f75f-5b25-4267-99de-689d8b5cb243 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:42.374084 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-3b188e56-0a7f-4c3b-84c0-2e9fa34a9da3 req-7ca6f75f-5b25-4267-99de-689d8b5cb243 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:42.387314 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-3b188e56-0a7f-4c3b-84c0-2e9fa34a9da3 req-7ca6f75f-5b25-4267-99de-689d8b5cb243 service nova] Creating event network-changed:40086b9f-1a65-40f2-9db4-6bf22c7ecd7d for instance c6d0afa1-510c-4954-8984-662702bb00dc on hv-cinder-82160 Jan 18 20:27:42.394048 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-3b188e56-0a7f-4c3b-84c0-2e9fa34a9da3 req-7ca6f75f-5b25-4267-99de-689d8b5cb243 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036056 Jan 18 20:27:42.395015 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 320/635] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:27:42.408919 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6e19841c-b59c-4b2d-a6fe-a15425264bcf tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:42.410076 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6e19841c-b59c-4b2d-a6fe-a15425264bcf tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:42.416867 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6e19841c-b59c-4b2d-a6fe-a15425264bcf tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:42.417316 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6e19841c-b59c-4b2d-a6fe-a15425264bcf tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:42.418108 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6e19841c-b59c-4b2d-a6fe-a15425264bcf tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:42.418729 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6e19841c-b59c-4b2d-a6fe-a15425264bcf tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:42.440740 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-16688ce0-785d-4766-bdd2-ee68c199765a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 14 microversion: 2.20 time: 0.091281 Jan 18 20:27:42.448454 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 316/636] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:27:42 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:42.701150 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6e19841c-b59c-4b2d-a6fe-a15425264bcf tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:42.708780 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6e19841c-b59c-4b2d-a6fe-a15425264bcf tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1260 microversion: 2.1 time: 0.303852 Jan 18 20:27:42.719003 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 321/637] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:42 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1260 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:42.796519 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e4a18b12-a3b3-407a-a5e2-7eb61decf5a3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-910539120", "imageRef": "c7d259ac-b206-430f-a3c0-794cee408236", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77f5e2c8-6d78-4c9e-bf28-d46a83b25db6"}], "security_groups": [{"name": "tempest-securitygroup--1463185037"}], "key_name": "tempest-keypair-1881757113", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:42.958808 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.network.neutron [None req-e4a18b12-a3b3-407a-a5e2-7eb61decf5a3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] validate_networks() for [('77f5e2c8-6d78-4c9e-bf28-d46a83b25db6', None, None, None, None, None)] {{(pid=116376) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:27:43.452380 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-42e0e382-c7e6-467a-9217-91e3cef3f6d7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:43.453319 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-42e0e382-c7e6-467a-9217-91e3cef3f6d7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:43.460224 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-42e0e382-c7e6-467a-9217-91e3cef3f6d7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:43.460678 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-42e0e382-c7e6-467a-9217-91e3cef3f6d7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:43.461468 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-42e0e382-c7e6-467a-9217-91e3cef3f6d7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:43.461901 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-42e0e382-c7e6-467a-9217-91e3cef3f6d7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:43.469554 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-e4a18b12-a3b3-407a-a5e2-7eb61decf5a3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Flavor limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:27:43.470076 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-e4a18b12-a3b3-407a-a5e2-7eb61decf5a3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Image limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:27:43.470653 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-e4a18b12-a3b3-407a-a5e2-7eb61decf5a3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Flavor pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:27:43.471198 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-e4a18b12-a3b3-407a-a5e2-7eb61decf5a3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Image pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:27:43.471847 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-e4a18b12-a3b3-407a-a5e2-7eb61decf5a3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:27:43.480973 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e4a18b12-a3b3-407a-a5e2-7eb61decf5a3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:43.481597 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e4a18b12-a3b3-407a-a5e2-7eb61decf5a3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:43.482519 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e4a18b12-a3b3-407a-a5e2-7eb61decf5a3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:43.483090 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e4a18b12-a3b3-407a-a5e2-7eb61decf5a3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:43.501724 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-e4a18b12-a3b3-407a-a5e2-7eb61decf5a3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Getting quotas for project 56295fd7b6c447b4a143879d64dd49da. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:27:43.505948 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-e4a18b12-a3b3-407a-a5e2-7eb61decf5a3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Getting quotas for user 526b24d5cecf4e078cd5188062e959f6 and project 56295fd7b6c447b4a143879d64dd49da. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:27:43.518351 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e4a18b12-a3b3-407a-a5e2-7eb61decf5a3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Going to run 1 instances... {{(pid=116376) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:27:43.521059 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-42e0e382-c7e6-467a-9217-91e3cef3f6d7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 14 microversion: 2.20 time: 0.072933 Jan 18 20:27:43.521220 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e4a18b12-a3b3-407a-a5e2-7eb61decf5a3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7d259ac-b206-430f-a3c0-794cee408236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116376) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:27:43.525881 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 322/638] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:27:43 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:27:43.569771 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e4a18b12-a3b3-407a-a5e2-7eb61decf5a3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.778508 Jan 18 20:27:43.570910 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 317/639] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:27:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 20:27:43.581680 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f5440104-b5e7-43e3-b788-ee52e6fe0e63 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:43.582392 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f5440104-b5e7-43e3-b788-ee52e6fe0e63 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:43.646042 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f5440104-b5e7-43e3-b788-ee52e6fe0e63 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:43.655760 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f5440104-b5e7-43e3-b788-ee52e6fe0e63 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1237 microversion: 2.1 time: 0.078118 Jan 18 20:27:43.656424 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 323/640] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:43 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1237 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:43.725299 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-88293f5e-0ea4-4c38-bd12-0e89612890c6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:43.726054 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-88293f5e-0ea4-4c38-bd12-0e89612890c6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:43.732346 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-88293f5e-0ea4-4c38-bd12-0e89612890c6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:43.733312 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-88293f5e-0ea4-4c38-bd12-0e89612890c6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:43.733813 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-88293f5e-0ea4-4c38-bd12-0e89612890c6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:43.734241 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-88293f5e-0ea4-4c38-bd12-0e89612890c6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:43.907639 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-88293f5e-0ea4-4c38-bd12-0e89612890c6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:43.915424 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-88293f5e-0ea4-4c38-bd12-0e89612890c6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1260 microversion: 2.1 time: 0.193742 Jan 18 20:27:43.916287 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 318/641] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:43 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:44.534286 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a01353ac-5cf7-47a5-b674-db5c202c596e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:44.535932 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a01353ac-5cf7-47a5-b674-db5c202c596e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:44.542721 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a01353ac-5cf7-47a5-b674-db5c202c596e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:44.543221 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a01353ac-5cf7-47a5-b674-db5c202c596e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:44.544931 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a01353ac-5cf7-47a5-b674-db5c202c596e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:44.545382 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a01353ac-5cf7-47a5-b674-db5c202c596e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:44.602517 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a01353ac-5cf7-47a5-b674-db5c202c596e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 14 microversion: 2.20 time: 0.072315 Jan 18 20:27:44.603176 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 324/642] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:27:44 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:44.676183 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-31a7944b-f553-4448-ac1c-ab347a0501d5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:44.678354 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-31a7944b-f553-4448-ac1c-ab347a0501d5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:44.688448 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-31a7944b-f553-4448-ac1c-ab347a0501d5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:44.689080 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-31a7944b-f553-4448-ac1c-ab347a0501d5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:44.690313 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-31a7944b-f553-4448-ac1c-ab347a0501d5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:44.690967 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-31a7944b-f553-4448-ac1c-ab347a0501d5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:44.776289 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-31a7944b-f553-4448-ac1c-ab347a0501d5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:44.785142 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-31a7944b-f553-4448-ac1c-ab347a0501d5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1295 microversion: 2.1 time: 0.115902 Jan 18 20:27:44.795429 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 319/643] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:44 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1295 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:44.933204 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-59649595-6dcb-4597-b592-55152266e5dd tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:44.934236 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-59649595-6dcb-4597-b592-55152266e5dd tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:44.944127 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-59649595-6dcb-4597-b592-55152266e5dd tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:44.944127 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-59649595-6dcb-4597-b592-55152266e5dd tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:44.944127 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-59649595-6dcb-4597-b592-55152266e5dd tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:44.944127 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-59649595-6dcb-4597-b592-55152266e5dd tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:45.109802 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-59649595-6dcb-4597-b592-55152266e5dd tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:45.118574 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-59649595-6dcb-4597-b592-55152266e5dd tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1260 microversion: 2.1 time: 0.189411 Jan 18 20:27:45.119213 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 325/644] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:44 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:45.613347 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-275759e3-4a75-4150-aa14-10760f1db863 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:45.614348 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-275759e3-4a75-4150-aa14-10760f1db863 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:45.621449 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-275759e3-4a75-4150-aa14-10760f1db863 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:45.621954 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-275759e3-4a75-4150-aa14-10760f1db863 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:45.623302 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-275759e3-4a75-4150-aa14-10760f1db863 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:45.623755 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-275759e3-4a75-4150-aa14-10760f1db863 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:45.681890 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-275759e3-4a75-4150-aa14-10760f1db863 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 14 microversion: 2.20 time: 0.072036 Jan 18 20:27:45.683216 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 320/645] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:27:45 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:45.803131 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-28c44fd7-501c-4005-8caf-61d1725f5488 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:45.804327 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-28c44fd7-501c-4005-8caf-61d1725f5488 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:45.811714 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-28c44fd7-501c-4005-8caf-61d1725f5488 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:45.812528 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-28c44fd7-501c-4005-8caf-61d1725f5488 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:45.813471 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-28c44fd7-501c-4005-8caf-61d1725f5488 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:45.814055 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-28c44fd7-501c-4005-8caf-61d1725f5488 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:45.977558 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-28c44fd7-501c-4005-8caf-61d1725f5488 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:45.985662 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-28c44fd7-501c-4005-8caf-61d1725f5488 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1363 microversion: 2.1 time: 0.186153 Jan 18 20:27:45.986244 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 326/646] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:45 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:27:46.140537 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b51e8648-c3b5-417e-849b-d0a5116f3ee9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:46.141610 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b51e8648-c3b5-417e-849b-d0a5116f3ee9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:46.149702 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b51e8648-c3b5-417e-849b-d0a5116f3ee9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:46.150159 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b51e8648-c3b5-417e-849b-d0a5116f3ee9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:46.151160 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b51e8648-c3b5-417e-849b-d0a5116f3ee9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:46.151645 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b51e8648-c3b5-417e-849b-d0a5116f3ee9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:46.354237 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-02e2b18d-3461-4d8c-af47-c5e6160f7710 req-4b35caa0-5422-41c6-8a6d-116f6abb99fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca1b7d23-2dbd-4028-8c9e-6760c49670aa", "tag": "ac71aa2f-ced3-4de1-af45-1e8fc62dff0f"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:46.360569 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:27:46.360569 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:27:46.411343 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-02e2b18d-3461-4d8c-af47-c5e6160f7710 req-4b35caa0-5422-41c6-8a6d-116f6abb99fa service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:46.411767 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-02e2b18d-3461-4d8c-af47-c5e6160f7710 req-4b35caa0-5422-41c6-8a6d-116f6abb99fa service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:46.450237 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-02e2b18d-3461-4d8c-af47-c5e6160f7710 req-4b35caa0-5422-41c6-8a6d-116f6abb99fa service nova] Creating event network-changed:ac71aa2f-ced3-4de1-af45-1e8fc62dff0f for instance ca1b7d23-2dbd-4028-8c9e-6760c49670aa on hv-cinder-82160 Jan 18 20:27:46.459899 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-02e2b18d-3461-4d8c-af47-c5e6160f7710 req-4b35caa0-5422-41c6-8a6d-116f6abb99fa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116449 Jan 18 20:27:46.461298 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 327/647] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:27:46.513622 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b51e8648-c3b5-417e-849b-d0a5116f3ee9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:46.522801 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b51e8648-c3b5-417e-849b-d0a5116f3ee9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1260 microversion: 2.1 time: 0.386416 Jan 18 20:27:46.533383 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 321/648] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:46 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1260 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:46.701825 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-dd4e514f-c481-4837-8160-a19d3e56b2fb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:46.704945 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-dd4e514f-c481-4837-8160-a19d3e56b2fb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:46.717590 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd4e514f-c481-4837-8160-a19d3e56b2fb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:46.718354 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd4e514f-c481-4837-8160-a19d3e56b2fb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:46.720006 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd4e514f-c481-4837-8160-a19d3e56b2fb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:46.721415 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd4e514f-c481-4837-8160-a19d3e56b2fb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:46.826120 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-dd4e514f-c481-4837-8160-a19d3e56b2fb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 14 microversion: 2.20 time: 0.134138 Jan 18 20:27:46.832595 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 328/649] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:27:46 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:27:47.010222 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4a9f81eb-f0d2-4fa3-9305-6d1fd0e43f03 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:47.011546 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-4a9f81eb-f0d2-4fa3-9305-6d1fd0e43f03 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:47.024826 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4a9f81eb-f0d2-4fa3-9305-6d1fd0e43f03 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:47.026152 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4a9f81eb-f0d2-4fa3-9305-6d1fd0e43f03 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:47.027778 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4a9f81eb-f0d2-4fa3-9305-6d1fd0e43f03 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:47.029173 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4a9f81eb-f0d2-4fa3-9305-6d1fd0e43f03 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:47.335676 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-4a9f81eb-f0d2-4fa3-9305-6d1fd0e43f03 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:47.356664 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-4a9f81eb-f0d2-4fa3-9305-6d1fd0e43f03 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1363 microversion: 2.1 time: 0.355473 Jan 18 20:27:47.358059 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 322/650] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:46 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1363 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:47.545017 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-327ebac0-aeb6-4403-9dc4-fadd9f085a1e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:47.546512 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-327ebac0-aeb6-4403-9dc4-fadd9f085a1e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:47.560888 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-327ebac0-aeb6-4403-9dc4-fadd9f085a1e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:47.562100 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-327ebac0-aeb6-4403-9dc4-fadd9f085a1e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:47.564019 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-327ebac0-aeb6-4403-9dc4-fadd9f085a1e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:47.565644 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-327ebac0-aeb6-4403-9dc4-fadd9f085a1e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:47.812625 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-327ebac0-aeb6-4403-9dc4-fadd9f085a1e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:47.826429 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-327ebac0-aeb6-4403-9dc4-fadd9f085a1e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1260 microversion: 2.1 time: 0.288875 Jan 18 20:27:47.827802 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 329/651] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:47 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1260 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:47.847269 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ace463b5-ecb8-4e7b-8ee7-d647ab224f99 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:47.848727 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ace463b5-ecb8-4e7b-8ee7-d647ab224f99 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:47.864810 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ace463b5-ecb8-4e7b-8ee7-d647ab224f99 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:47.865741 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ace463b5-ecb8-4e7b-8ee7-d647ab224f99 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:47.867569 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ace463b5-ecb8-4e7b-8ee7-d647ab224f99 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:47.869543 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ace463b5-ecb8-4e7b-8ee7-d647ab224f99 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:47.961907 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ace463b5-ecb8-4e7b-8ee7-d647ab224f99 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 14 microversion: 2.20 time: 0.124578 Jan 18 20:27:47.966166 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 323/652] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:27:47 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:48.381032 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-857d58f3-5e3e-4681-b021-172f1ddcb10d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:48.382230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-857d58f3-5e3e-4681-b021-172f1ddcb10d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:48.391503 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-857d58f3-5e3e-4681-b021-172f1ddcb10d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:48.392217 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-857d58f3-5e3e-4681-b021-172f1ddcb10d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:48.393354 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-857d58f3-5e3e-4681-b021-172f1ddcb10d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:48.393963 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-857d58f3-5e3e-4681-b021-172f1ddcb10d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:48.603011 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-857d58f3-5e3e-4681-b021-172f1ddcb10d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:48.613377 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-857d58f3-5e3e-4681-b021-172f1ddcb10d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1363 microversion: 2.1 time: 0.236188 Jan 18 20:27:48.614070 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 330/653] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:48 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:48.850716 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b0aa8b45-ab64-4e92-b24b-2d823f944a1e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:48.852294 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b0aa8b45-ab64-4e92-b24b-2d823f944a1e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:48.861209 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b0aa8b45-ab64-4e92-b24b-2d823f944a1e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:48.861209 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b0aa8b45-ab64-4e92-b24b-2d823f944a1e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:48.861600 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b0aa8b45-ab64-4e92-b24b-2d823f944a1e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:48.862036 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b0aa8b45-ab64-4e92-b24b-2d823f944a1e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:48.975352 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d676a87c-61b6-4706-9e63-e612e4ff9d00 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:48.977166 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d676a87c-61b6-4706-9e63-e612e4ff9d00 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:48.987226 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d676a87c-61b6-4706-9e63-e612e4ff9d00 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:48.988018 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d676a87c-61b6-4706-9e63-e612e4ff9d00 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:48.989666 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d676a87c-61b6-4706-9e63-e612e4ff9d00 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:48.990859 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d676a87c-61b6-4706-9e63-e612e4ff9d00 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:49.060427 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d676a87c-61b6-4706-9e63-e612e4ff9d00 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 14 microversion: 2.20 time: 0.088331 Jan 18 20:27:49.062179 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 331/654] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:27:48 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:27:49.073264 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-89d11dae-8a7c-4dce-84c6-99af9e9cf851 req-c1771202-9007-45d4-a9f4-434ace719a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3922fa1-08be-4eee-9088-5ccf7cf4014e", "name": "network-vif-plugged", "status": "completed", "tag": "f1f716af-ae09-4a01-8a29-d7bb8bff9321"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:49.078168 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:27:49.078168 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:27:49.094065 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-89d11dae-8a7c-4dce-84c6-99af9e9cf851 req-c1771202-9007-45d4-a9f4-434ace719a08 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:49.094870 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-89d11dae-8a7c-4dce-84c6-99af9e9cf851 req-c1771202-9007-45d4-a9f4-434ace719a08 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:49.118955 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-89d11dae-8a7c-4dce-84c6-99af9e9cf851 req-c1771202-9007-45d4-a9f4-434ace719a08 service nova] Creating event network-vif-plugged:f1f716af-ae09-4a01-8a29-d7bb8bff9321 for instance d3922fa1-08be-4eee-9088-5ccf7cf4014e on hv-cinder-82160 Jan 18 20:27:49.128814 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-89d11dae-8a7c-4dce-84c6-99af9e9cf851 req-c1771202-9007-45d4-a9f4-434ace719a08 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062928 Jan 18 20:27:49.129904 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 332/655] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:27:49.147248 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b0aa8b45-ab64-4e92-b24b-2d823f944a1e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:49.159255 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b0aa8b45-ab64-4e92-b24b-2d823f944a1e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1260 microversion: 2.1 time: 0.315617 Jan 18 20:27:49.160302 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 324/656] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:48 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1260 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:27:49.643185 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-89b78fd1-ed44-4840-aa9d-d1afb3ddebe6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:49.643949 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-89b78fd1-ed44-4840-aa9d-d1afb3ddebe6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:49.651918 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-89b78fd1-ed44-4840-aa9d-d1afb3ddebe6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:49.652372 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-89b78fd1-ed44-4840-aa9d-d1afb3ddebe6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:49.653792 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-89b78fd1-ed44-4840-aa9d-d1afb3ddebe6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:49.654269 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-89b78fd1-ed44-4840-aa9d-d1afb3ddebe6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:49.812496 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-89b78fd1-ed44-4840-aa9d-d1afb3ddebe6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:49.821144 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-89b78fd1-ed44-4840-aa9d-d1afb3ddebe6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1363 microversion: 2.1 time: 0.183960 Jan 18 20:27:49.821737 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 333/657] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:49 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:50.073078 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ba7f56b8-ae86-49aa-b13e-821a2fb3bb50 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:50.074417 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ba7f56b8-ae86-49aa-b13e-821a2fb3bb50 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:50.085466 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ba7f56b8-ae86-49aa-b13e-821a2fb3bb50 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:50.086199 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ba7f56b8-ae86-49aa-b13e-821a2fb3bb50 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:50.087652 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ba7f56b8-ae86-49aa-b13e-821a2fb3bb50 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:50.088319 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ba7f56b8-ae86-49aa-b13e-821a2fb3bb50 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:50.151375 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ba7f56b8-ae86-49aa-b13e-821a2fb3bb50 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 14 microversion: 2.20 time: 0.082108 Jan 18 20:27:50.152009 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 325/658] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:27:50 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:27:50.185012 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-57d776a5-e960-477f-889d-7141496fbb8b tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:50.185735 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-57d776a5-e960-477f-889d-7141496fbb8b tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:50.192970 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-57d776a5-e960-477f-889d-7141496fbb8b tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:50.193488 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-57d776a5-e960-477f-889d-7141496fbb8b tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:50.194382 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-57d776a5-e960-477f-889d-7141496fbb8b tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:50.194872 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-57d776a5-e960-477f-889d-7141496fbb8b tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:50.371633 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-57d776a5-e960-477f-889d-7141496fbb8b tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:50.379753 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-57d776a5-e960-477f-889d-7141496fbb8b tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1260 microversion: 2.1 time: 0.199086 Jan 18 20:27:50.380416 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 334/659] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:50 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:50.841810 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-804ec233-cd20-4ce8-adf2-92f38c21d7fb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:50.842625 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-804ec233-cd20-4ce8-adf2-92f38c21d7fb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:50.850490 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-804ec233-cd20-4ce8-adf2-92f38c21d7fb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:50.850945 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-804ec233-cd20-4ce8-adf2-92f38c21d7fb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:50.851813 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-804ec233-cd20-4ce8-adf2-92f38c21d7fb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:50.852258 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-804ec233-cd20-4ce8-adf2-92f38c21d7fb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:51.015338 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-804ec233-cd20-4ce8-adf2-92f38c21d7fb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:51.027531 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-804ec233-cd20-4ce8-adf2-92f38c21d7fb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1363 microversion: 2.1 time: 0.190283 Jan 18 20:27:51.028178 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 326/660] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:50 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:51.166748 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8afd3118-33f7-43b7-a24e-8c735365f1cb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:51.167724 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8afd3118-33f7-43b7-a24e-8c735365f1cb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:51.174773 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8afd3118-33f7-43b7-a24e-8c735365f1cb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:51.175339 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8afd3118-33f7-43b7-a24e-8c735365f1cb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:51.176167 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8afd3118-33f7-43b7-a24e-8c735365f1cb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:51.176608 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8afd3118-33f7-43b7-a24e-8c735365f1cb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:51.238817 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8afd3118-33f7-43b7-a24e-8c735365f1cb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 14 microversion: 2.20 time: 0.078431 Jan 18 20:27:51.239899 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 335/661] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:27:51 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:27:51.400295 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-c67914c2-bd8d-4632-8909-74b2e583bdd9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:51.401551 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-c67914c2-bd8d-4632-8909-74b2e583bdd9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:51.413642 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c67914c2-bd8d-4632-8909-74b2e583bdd9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:51.414390 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c67914c2-bd8d-4632-8909-74b2e583bdd9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:51.416007 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c67914c2-bd8d-4632-8909-74b2e583bdd9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:51.416717 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c67914c2-bd8d-4632-8909-74b2e583bdd9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:51.598279 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-c67914c2-bd8d-4632-8909-74b2e583bdd9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:51.607176 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-c67914c2-bd8d-4632-8909-74b2e583bdd9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1443 microversion: 2.1 time: 0.213006 Jan 18 20:27:51.607757 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 327/662] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:51 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1443 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:27:51.625923 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8861c06d-6933-48e1-858b-e6edf21a5f4a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:51.626622 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8861c06d-6933-48e1-858b-e6edf21a5f4a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:51.633637 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8861c06d-6933-48e1-858b-e6edf21a5f4a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:51.634087 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8861c06d-6933-48e1-858b-e6edf21a5f4a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:51.634878 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8861c06d-6933-48e1-858b-e6edf21a5f4a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:51.635349 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8861c06d-6933-48e1-858b-e6edf21a5f4a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:51.818158 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8861c06d-6933-48e1-858b-e6edf21a5f4a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:51.826802 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8861c06d-6933-48e1-858b-e6edf21a5f4a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1443 microversion: 2.1 time: 0.205189 Jan 18 20:27:51.827480 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 336/663] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:51 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1443 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:52.051527 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-025378ac-5e8c-4391-9693-18cd119b1d7f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:52.052454 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-025378ac-5e8c-4391-9693-18cd119b1d7f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:52.059582 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-025378ac-5e8c-4391-9693-18cd119b1d7f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:52.060035 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-025378ac-5e8c-4391-9693-18cd119b1d7f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:52.060845 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-025378ac-5e8c-4391-9693-18cd119b1d7f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:52.061294 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-025378ac-5e8c-4391-9693-18cd119b1d7f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:52.250180 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fc067aa6-b7c1-47e9-919d-7b57726f148b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:52.252359 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fc067aa6-b7c1-47e9-919d-7b57726f148b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:52.262620 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fc067aa6-b7c1-47e9-919d-7b57726f148b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:52.263797 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fc067aa6-b7c1-47e9-919d-7b57726f148b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:52.265154 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fc067aa6-b7c1-47e9-919d-7b57726f148b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:52.266321 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fc067aa6-b7c1-47e9-919d-7b57726f148b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:52.291713 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-025378ac-5e8c-4391-9693-18cd119b1d7f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:52.300937 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-025378ac-5e8c-4391-9693-18cd119b1d7f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1363 microversion: 2.1 time: 0.256685 Jan 18 20:27:52.302024 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 328/664] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:52 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:27:52.350891 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fc067aa6-b7c1-47e9-919d-7b57726f148b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 14 microversion: 2.20 time: 0.104254 Jan 18 20:27:52.351463 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 337/665] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:27:52 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:53.137369 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-a9fdf89b-f2b3-40a9-89c1-ed54bd49c281 req-1c4d395b-6b47-402a-948d-730fccceaf07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1b7d23-2dbd-4028-8c9e-6760c49670aa", "name": "network-vif-plugged", "status": "completed", "tag": "ac71aa2f-ced3-4de1-af45-1e8fc62dff0f"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:53.140629 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:27:53.140629 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:27:53.155129 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-a9fdf89b-f2b3-40a9-89c1-ed54bd49c281 req-1c4d395b-6b47-402a-948d-730fccceaf07 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:53.156222 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-a9fdf89b-f2b3-40a9-89c1-ed54bd49c281 req-1c4d395b-6b47-402a-948d-730fccceaf07 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:53.173293 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-a9fdf89b-f2b3-40a9-89c1-ed54bd49c281 req-1c4d395b-6b47-402a-948d-730fccceaf07 service nova] Creating event network-vif-plugged:ac71aa2f-ced3-4de1-af45-1e8fc62dff0f for instance ca1b7d23-2dbd-4028-8c9e-6760c49670aa on hv-cinder-82160 Jan 18 20:27:53.178485 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-a9fdf89b-f2b3-40a9-89c1-ed54bd49c281 req-1c4d395b-6b47-402a-948d-730fccceaf07 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048096 Jan 18 20:27:53.179412 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 329/666] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:27:53.323584 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c068d854-2b84-4591-ae9c-941fb6575c1f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:53.325653 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c068d854-2b84-4591-ae9c-941fb6575c1f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:53.338515 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c068d854-2b84-4591-ae9c-941fb6575c1f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:53.339380 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c068d854-2b84-4591-ae9c-941fb6575c1f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:53.340888 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c068d854-2b84-4591-ae9c-941fb6575c1f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:53.341898 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c068d854-2b84-4591-ae9c-941fb6575c1f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:53.366671 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d374c90a-345a-452a-b820-37dd6cd3a2c2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:53.368976 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d374c90a-345a-452a-b820-37dd6cd3a2c2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:53.382259 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d374c90a-345a-452a-b820-37dd6cd3a2c2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:53.383455 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d374c90a-345a-452a-b820-37dd6cd3a2c2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:53.385089 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d374c90a-345a-452a-b820-37dd6cd3a2c2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:53.386083 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d374c90a-345a-452a-b820-37dd6cd3a2c2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:53.482171 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d374c90a-345a-452a-b820-37dd6cd3a2c2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 5222 microversion: 2.20 time: 0.121720 Jan 18 20:27:53.488183 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 330/667] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:27:53 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 5222 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:27:53.656022 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c068d854-2b84-4591-ae9c-941fb6575c1f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:53.664009 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c068d854-2b84-4591-ae9c-941fb6575c1f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1363 microversion: 2.1 time: 0.348619 Jan 18 20:27:53.664612 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 338/668] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:53 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1363 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:54.497952 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-94f38579-dc3b-45a7-906c-7ef72028f48f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:54.498886 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-94f38579-dc3b-45a7-906c-7ef72028f48f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:54.501831 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-d2ded75a-3ecc-4e66-83d8-4f8000cd1f16 req-298faabd-1ec0-4d70-b361-0390997cd573 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3922fa1-08be-4eee-9088-5ccf7cf4014e", "tag": "f1f716af-ae09-4a01-8a29-d7bb8bff9321"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:54.503536 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:27:54.503536 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:27:54.519847 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-d2ded75a-3ecc-4e66-83d8-4f8000cd1f16 req-298faabd-1ec0-4d70-b361-0390997cd573 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:54.520881 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-d2ded75a-3ecc-4e66-83d8-4f8000cd1f16 req-298faabd-1ec0-4d70-b361-0390997cd573 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:54.522132 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94f38579-dc3b-45a7-906c-7ef72028f48f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:54.522900 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94f38579-dc3b-45a7-906c-7ef72028f48f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:54.523862 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94f38579-dc3b-45a7-906c-7ef72028f48f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:54.524290 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94f38579-dc3b-45a7-906c-7ef72028f48f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:54.546432 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-d2ded75a-3ecc-4e66-83d8-4f8000cd1f16 req-298faabd-1ec0-4d70-b361-0390997cd573 service nova] Creating event network-changed:f1f716af-ae09-4a01-8a29-d7bb8bff9321 for instance d3922fa1-08be-4eee-9088-5ccf7cf4014e on hv-cinder-82160 Jan 18 20:27:54.556076 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-d2ded75a-3ecc-4e66-83d8-4f8000cd1f16 req-298faabd-1ec0-4d70-b361-0390997cd573 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068521 Jan 18 20:27:54.560122 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 331/669] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:27:54.635708 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-94f38579-dc3b-45a7-906c-7ef72028f48f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 13731 microversion: 2.20 time: 0.141886 Jan 18 20:27:54.643488 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 339/670] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:27:54 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 13731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:27:54.690404 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-3d7d4b90-aba7-4afc-9ea5-be011d6d9221 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:54.692356 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-3d7d4b90-aba7-4afc-9ea5-be011d6d9221 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:54.708796 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3d7d4b90-aba7-4afc-9ea5-be011d6d9221 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:54.709725 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3d7d4b90-aba7-4afc-9ea5-be011d6d9221 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:54.711707 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3d7d4b90-aba7-4afc-9ea5-be011d6d9221 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:54.712604 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3d7d4b90-aba7-4afc-9ea5-be011d6d9221 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:55.006958 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-3d7d4b90-aba7-4afc-9ea5-be011d6d9221 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:27:55.015931 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-3d7d4b90-aba7-4afc-9ea5-be011d6d9221 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1549 microversion: 2.1 time: 0.336127 Jan 18 20:27:55.017084 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 332/671] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:27:54 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1549 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:27:55.034598 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9e936e78-8068-4cef-a3cd-3e51b5e58fbb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:27:55.035223 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9e936e78-8068-4cef-a3cd-3e51b5e58fbb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:55.042653 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9e936e78-8068-4cef-a3cd-3e51b5e58fbb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:55.043002 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9e936e78-8068-4cef-a3cd-3e51b5e58fbb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:55.043868 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9e936e78-8068-4cef-a3cd-3e51b5e58fbb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:55.044562 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9e936e78-8068-4cef-a3cd-3e51b5e58fbb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:55.173125 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9e936e78-8068-4cef-a3cd-3e51b5e58fbb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142972 Jan 18 20:27:55.173958 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 340/672] 10.222.0.67 () {58 vars in 1274 bytes} [Tue Jan 18 20:27:55 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:27:55.653992 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e41b96b7-0631-428d-8c20-e6576498c058 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:55.656118 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e41b96b7-0631-428d-8c20-e6576498c058 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:55.668154 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e41b96b7-0631-428d-8c20-e6576498c058 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:55.669490 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e41b96b7-0631-428d-8c20-e6576498c058 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:55.671004 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e41b96b7-0631-428d-8c20-e6576498c058 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:55.671856 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e41b96b7-0631-428d-8c20-e6576498c058 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:55.768573 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e41b96b7-0631-428d-8c20-e6576498c058 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 18398 microversion: 2.20 time: 0.121019 Jan 18 20:27:55.769488 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 333/673] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:27:55 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 18398 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:27:56.395832 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-19c1c187-4f3f-4231-8c36-e3ca1e9a93df tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:56.397364 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-19c1c187-4f3f-4231-8c36-e3ca1e9a93df tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:56.405282 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-19c1c187-4f3f-4231-8c36-e3ca1e9a93df tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:56.405725 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-19c1c187-4f3f-4231-8c36-e3ca1e9a93df tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:56.406523 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-19c1c187-4f3f-4231-8c36-e3ca1e9a93df tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:56.407230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-19c1c187-4f3f-4231-8c36-e3ca1e9a93df tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:56.487892 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-19c1c187-4f3f-4231-8c36-e3ca1e9a93df tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 14 microversion: 2.1 time: 0.096921 Jan 18 20:27:56.491139 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 341/674] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:27:56 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:27:56.577259 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-af03dc4b-de94-4739-b9d9-f6cfd22dcce0 req-19a1d6ba-3a9d-4b2f-8e23-436cd2f79de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca1b7d23-2dbd-4028-8c9e-6760c49670aa", "tag": "ac71aa2f-ced3-4de1-af45-1e8fc62dff0f"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:56.579125 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:27:56.579125 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:27:56.587669 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-af03dc4b-de94-4739-b9d9-f6cfd22dcce0 req-19a1d6ba-3a9d-4b2f-8e23-436cd2f79de5 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:56.588151 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-af03dc4b-de94-4739-b9d9-f6cfd22dcce0 req-19a1d6ba-3a9d-4b2f-8e23-436cd2f79de5 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:56.602834 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-af03dc4b-de94-4739-b9d9-f6cfd22dcce0 req-19a1d6ba-3a9d-4b2f-8e23-436cd2f79de5 service nova] Creating event network-changed:ac71aa2f-ced3-4de1-af45-1e8fc62dff0f for instance ca1b7d23-2dbd-4028-8c9e-6760c49670aa on hv-cinder-82160 Jan 18 20:27:56.608382 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-af03dc4b-de94-4739-b9d9-f6cfd22dcce0 req-19a1d6ba-3a9d-4b2f-8e23-436cd2f79de5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035992 Jan 18 20:27:56.608993 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 334/675] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:27:56.788416 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-377ad666-e292-4404-84f1-eb93c23cda0f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:56.790120 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-377ad666-e292-4404-84f1-eb93c23cda0f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:56.801903 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-377ad666-e292-4404-84f1-eb93c23cda0f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:56.802587 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-377ad666-e292-4404-84f1-eb93c23cda0f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:56.805025 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-377ad666-e292-4404-84f1-eb93c23cda0f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:56.806225 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-377ad666-e292-4404-84f1-eb93c23cda0f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:56.900237 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-377ad666-e292-4404-84f1-eb93c23cda0f tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 19342 microversion: 2.20 time: 0.120339 Jan 18 20:27:56.902001 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 342/676] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:27:56 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 19342 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:27:57.502011 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-135de190-5637-4df8-a5ed-65833ef89f84 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:57.503085 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-135de190-5637-4df8-a5ed-65833ef89f84 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:57.510245 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-135de190-5637-4df8-a5ed-65833ef89f84 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:57.510695 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-135de190-5637-4df8-a5ed-65833ef89f84 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:57.511520 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-135de190-5637-4df8-a5ed-65833ef89f84 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:57.511958 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-135de190-5637-4df8-a5ed-65833ef89f84 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:57.590062 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-135de190-5637-4df8-a5ed-65833ef89f84 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 14 microversion: 2.1 time: 0.092434 Jan 18 20:27:57.590695 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 335/677] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:27:57 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:27:57.914482 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-67e5a98c-343f-4850-85e8-bfb9d7b65176 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:57.915514 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-67e5a98c-343f-4850-85e8-bfb9d7b65176 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:57.923341 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67e5a98c-343f-4850-85e8-bfb9d7b65176 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:57.923790 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67e5a98c-343f-4850-85e8-bfb9d7b65176 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:57.924579 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67e5a98c-343f-4850-85e8-bfb9d7b65176 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:57.925014 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67e5a98c-343f-4850-85e8-bfb9d7b65176 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:58.001527 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-67e5a98c-343f-4850-85e8-bfb9d7b65176 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 21966 microversion: 2.20 time: 0.090853 Jan 18 20:27:58.002174 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 343/678] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:27:57 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 21966 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:27:58.603137 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-3777c76e-2c07-4835-b812-90462b8c5a30 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:58.604133 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-3777c76e-2c07-4835-b812-90462b8c5a30 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:58.611203 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3777c76e-2c07-4835-b812-90462b8c5a30 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:58.611652 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3777c76e-2c07-4835-b812-90462b8c5a30 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:58.612432 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3777c76e-2c07-4835-b812-90462b8c5a30 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:58.612871 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3777c76e-2c07-4835-b812-90462b8c5a30 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:58.672698 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-3777c76e-2c07-4835-b812-90462b8c5a30 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 14 microversion: 2.1 time: 0.074779 Jan 18 20:27:58.673335 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 336/679] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:27:58 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 18 20:27:59.014708 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-806bf873-6544-4b64-a0c3-92550c5b9b91 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:59.015767 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-806bf873-6544-4b64-a0c3-92550c5b9b91 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:59.022976 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-806bf873-6544-4b64-a0c3-92550c5b9b91 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:59.023458 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-806bf873-6544-4b64-a0c3-92550c5b9b91 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:59.024268 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-806bf873-6544-4b64-a0c3-92550c5b9b91 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:59.024746 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-806bf873-6544-4b64-a0c3-92550c5b9b91 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:59.096330 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-806bf873-6544-4b64-a0c3-92550c5b9b91 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 23229 microversion: 2.20 time: 0.086273 Jan 18 20:27:59.097039 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 344/680] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:27:59 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 23229 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:27:59.683345 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-495c0086-09f6-476d-97ac-84389174186b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:27:59.684864 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-495c0086-09f6-476d-97ac-84389174186b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:27:59.692631 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-495c0086-09f6-476d-97ac-84389174186b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:59.693085 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-495c0086-09f6-476d-97ac-84389174186b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:59.693916 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-495c0086-09f6-476d-97ac-84389174186b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:27:59.694350 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-495c0086-09f6-476d-97ac-84389174186b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:27:59.754626 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-495c0086-09f6-476d-97ac-84389174186b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 14 microversion: 2.1 time: 0.075211 Jan 18 20:27:59.755330 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 337/681] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:27:59 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:28:00.109243 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-cb6de8db-78c4-4c32-9a38-40d72258bf82 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:00.110271 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-cb6de8db-78c4-4c32-9a38-40d72258bf82 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:00.117409 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cb6de8db-78c4-4c32-9a38-40d72258bf82 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:00.117849 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cb6de8db-78c4-4c32-9a38-40d72258bf82 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:00.118625 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cb6de8db-78c4-4c32-9a38-40d72258bf82 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:00.119070 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cb6de8db-78c4-4c32-9a38-40d72258bf82 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:00.199212 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-cb6de8db-78c4-4c32-9a38-40d72258bf82 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 24692 microversion: 2.20 time: 0.094370 Jan 18 20:28:00.199878 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 345/682] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:00 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 24692 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:00.771411 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fdb0df63-2e6a-49d7-adce-468e536170b1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:00.773311 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-fdb0df63-2e6a-49d7-adce-468e536170b1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:00.786867 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fdb0df63-2e6a-49d7-adce-468e536170b1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:00.787704 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fdb0df63-2e6a-49d7-adce-468e536170b1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:00.789088 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fdb0df63-2e6a-49d7-adce-468e536170b1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:00.789915 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fdb0df63-2e6a-49d7-adce-468e536170b1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:00.879498 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-fdb0df63-2e6a-49d7-adce-468e536170b1 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 14 microversion: 2.1 time: 0.116021 Jan 18 20:28:00.880324 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 338/683] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:00 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:28:01.211721 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-248ff259-aa02-4cb2-a539-456b792df028 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:01.213094 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-248ff259-aa02-4cb2-a539-456b792df028 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:01.221123 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-248ff259-aa02-4cb2-a539-456b792df028 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:01.221673 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-248ff259-aa02-4cb2-a539-456b792df028 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:01.222913 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-248ff259-aa02-4cb2-a539-456b792df028 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:01.223394 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-248ff259-aa02-4cb2-a539-456b792df028 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:01.301101 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-248ff259-aa02-4cb2-a539-456b792df028 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 26135 microversion: 2.20 time: 0.093646 Jan 18 20:28:01.301740 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 346/684] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:01 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 26135 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:01.891252 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-baad73b5-f6a1-439c-a7ff-95758bb27dff tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:01.892301 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-baad73b5-f6a1-439c-a7ff-95758bb27dff tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:01.901669 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-baad73b5-f6a1-439c-a7ff-95758bb27dff tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:01.902115 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-baad73b5-f6a1-439c-a7ff-95758bb27dff tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:01.903469 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-baad73b5-f6a1-439c-a7ff-95758bb27dff tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:01.903903 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-baad73b5-f6a1-439c-a7ff-95758bb27dff tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:01.973781 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-baad73b5-f6a1-439c-a7ff-95758bb27dff tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 14 microversion: 2.1 time: 0.086488 Jan 18 20:28:01.974428 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 339/685] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:01 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:28:02.313824 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f414041a-6955-45b2-b193-ca238edec7f3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:02.314830 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f414041a-6955-45b2-b193-ca238edec7f3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:02.322001 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f414041a-6955-45b2-b193-ca238edec7f3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:02.322453 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f414041a-6955-45b2-b193-ca238edec7f3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:02.323281 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f414041a-6955-45b2-b193-ca238edec7f3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:02.323726 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f414041a-6955-45b2-b193-ca238edec7f3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:02.409113 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f414041a-6955-45b2-b193-ca238edec7f3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 27023 microversion: 2.20 time: 0.099152 Jan 18 20:28:02.409763 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 347/686] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:02 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 27023 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:28:02.985983 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-1c2aca78-5008-4f21-9084-2f83456e2a25 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:02.987005 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-1c2aca78-5008-4f21-9084-2f83456e2a25 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:02.994480 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1c2aca78-5008-4f21-9084-2f83456e2a25 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:02.994930 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1c2aca78-5008-4f21-9084-2f83456e2a25 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:02.995766 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1c2aca78-5008-4f21-9084-2f83456e2a25 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:02.996823 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1c2aca78-5008-4f21-9084-2f83456e2a25 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:03.063492 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-1c2aca78-5008-4f21-9084-2f83456e2a25 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 14 microversion: 2.1 time: 0.081021 Jan 18 20:28:03.064665 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 340/687] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:02 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:28:03.421290 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-40727ab2-bb96-43d3-8df2-777df37b2c52 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:03.422315 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-40727ab2-bb96-43d3-8df2-777df37b2c52 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:03.429801 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-40727ab2-bb96-43d3-8df2-777df37b2c52 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:03.430241 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-40727ab2-bb96-43d3-8df2-777df37b2c52 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:03.431066 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-40727ab2-bb96-43d3-8df2-777df37b2c52 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:03.431496 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-40727ab2-bb96-43d3-8df2-777df37b2c52 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:03.517526 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-40727ab2-bb96-43d3-8df2-777df37b2c52 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 27580 microversion: 2.20 time: 0.100185 Jan 18 20:28:03.518191 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 348/688] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:03 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 27580 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:28:04.076375 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-2dc694ad-fe50-45e2-a889-02ed964f44ea tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:04.077813 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-2dc694ad-fe50-45e2-a889-02ed964f44ea tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:04.085239 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2dc694ad-fe50-45e2-a889-02ed964f44ea tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:04.085692 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2dc694ad-fe50-45e2-a889-02ed964f44ea tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:04.086499 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2dc694ad-fe50-45e2-a889-02ed964f44ea tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:04.086938 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2dc694ad-fe50-45e2-a889-02ed964f44ea tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:04.159213 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2dc694ad-fe50-45e2-a889-02ed964f44ea tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 14 microversion: 2.1 time: 0.087187 Jan 18 20:28:04.159854 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 341/689] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:04 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:28:04.531651 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5e2a9352-5f79-48cc-8f19-114fc525d67a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:04.532705 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5e2a9352-5f79-48cc-8f19-114fc525d67a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:04.539621 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5e2a9352-5f79-48cc-8f19-114fc525d67a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:04.540072 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5e2a9352-5f79-48cc-8f19-114fc525d67a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:04.540965 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5e2a9352-5f79-48cc-8f19-114fc525d67a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:04.541407 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5e2a9352-5f79-48cc-8f19-114fc525d67a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:04.624769 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5e2a9352-5f79-48cc-8f19-114fc525d67a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 27888 microversion: 2.20 time: 0.098587 Jan 18 20:28:04.625432 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 349/690] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:04 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 27888 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:05.171773 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-bb857298-c58b-446a-bb62-c5615b022f34 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:05.172990 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-bb857298-c58b-446a-bb62-c5615b022f34 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:05.180646 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bb857298-c58b-446a-bb62-c5615b022f34 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:05.181096 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bb857298-c58b-446a-bb62-c5615b022f34 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:05.181902 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bb857298-c58b-446a-bb62-c5615b022f34 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:05.182340 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bb857298-c58b-446a-bb62-c5615b022f34 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:05.258927 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-bb857298-c58b-446a-bb62-c5615b022f34 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 14 microversion: 2.1 time: 0.091865 Jan 18 20:28:05.259594 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 342/691] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:05 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:28:05.637245 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-417621d3-b17d-40db-9795-db4c5fd1b739 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:05.638271 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-417621d3-b17d-40db-9795-db4c5fd1b739 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:05.645799 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-417621d3-b17d-40db-9795-db4c5fd1b739 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:05.646229 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-417621d3-b17d-40db-9795-db4c5fd1b739 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:05.647057 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-417621d3-b17d-40db-9795-db4c5fd1b739 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:05.647480 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-417621d3-b17d-40db-9795-db4c5fd1b739 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:05.731469 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-417621d3-b17d-40db-9795-db4c5fd1b739 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 28186 microversion: 2.20 time: 0.097577 Jan 18 20:28:05.732294 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 350/692] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:05 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 28186 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:06.273724 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d2ee0e8c-bb16-4ae3-9884-9d0186c9e193 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:06.275250 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d2ee0e8c-bb16-4ae3-9884-9d0186c9e193 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:06.285929 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d2ee0e8c-bb16-4ae3-9884-9d0186c9e193 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:06.286378 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d2ee0e8c-bb16-4ae3-9884-9d0186c9e193 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:06.287212 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d2ee0e8c-bb16-4ae3-9884-9d0186c9e193 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:06.287648 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d2ee0e8c-bb16-4ae3-9884-9d0186c9e193 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:06.358496 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d2ee0e8c-bb16-4ae3-9884-9d0186c9e193 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 14 microversion: 2.1 time: 0.091539 Jan 18 20:28:06.359172 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 343/693] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:06 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:28:06.744392 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e924de68-3665-478e-9e9d-746a2c09356d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:06.745407 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e924de68-3665-478e-9e9d-746a2c09356d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:06.754324 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e924de68-3665-478e-9e9d-746a2c09356d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:06.754784 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e924de68-3665-478e-9e9d-746a2c09356d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:06.755604 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e924de68-3665-478e-9e9d-746a2c09356d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:06.756111 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e924de68-3665-478e-9e9d-746a2c09356d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:06.830845 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e924de68-3665-478e-9e9d-746a2c09356d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 28186 microversion: 2.20 time: 0.090624 Jan 18 20:28:06.831561 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 351/694] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:06 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 28186 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:07.370086 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4b3c3e5f-ca8b-40c2-9fce-593ee145412a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:07.371307 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-4b3c3e5f-ca8b-40c2-9fce-593ee145412a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:07.378689 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4b3c3e5f-ca8b-40c2-9fce-593ee145412a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:07.379186 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4b3c3e5f-ca8b-40c2-9fce-593ee145412a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:07.379971 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4b3c3e5f-ca8b-40c2-9fce-593ee145412a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:07.380397 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4b3c3e5f-ca8b-40c2-9fce-593ee145412a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:07.453855 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-4b3c3e5f-ca8b-40c2-9fce-593ee145412a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 14 microversion: 2.1 time: 0.087729 Jan 18 20:28:07.454507 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 344/695] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:07 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:28:07.843953 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9f8fbd8e-c3ae-49a2-94f5-3cfcb137301e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:07.845057 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9f8fbd8e-c3ae-49a2-94f5-3cfcb137301e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:07.852779 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f8fbd8e-c3ae-49a2-94f5-3cfcb137301e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:07.853230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f8fbd8e-c3ae-49a2-94f5-3cfcb137301e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:07.854082 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f8fbd8e-c3ae-49a2-94f5-3cfcb137301e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:07.854560 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f8fbd8e-c3ae-49a2-94f5-3cfcb137301e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:07.937295 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9f8fbd8e-c3ae-49a2-94f5-3cfcb137301e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 28477 microversion: 2.20 time: 0.097836 Jan 18 20:28:07.937880 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 352/696] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:07 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 28477 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:28:08.465720 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-073711b2-0472-49e2-a849-718837c2538d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:08.466772 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-073711b2-0472-49e2-a849-718837c2538d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:08.474181 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-073711b2-0472-49e2-a849-718837c2538d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:08.474634 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-073711b2-0472-49e2-a849-718837c2538d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:08.475461 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-073711b2-0472-49e2-a849-718837c2538d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:08.475903 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-073711b2-0472-49e2-a849-718837c2538d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:08.559756 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-073711b2-0472-49e2-a849-718837c2538d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 7815 microversion: 2.1 time: 0.097813 Jan 18 20:28:08.560414 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 345/697] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:08 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 7815 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:28:08.949942 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ca68274c-7551-4293-bb61-0b178640f281 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:08.950958 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ca68274c-7551-4293-bb61-0b178640f281 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:08.958133 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca68274c-7551-4293-bb61-0b178640f281 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:08.958587 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca68274c-7551-4293-bb61-0b178640f281 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:08.959410 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca68274c-7551-4293-bb61-0b178640f281 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:08.959846 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca68274c-7551-4293-bb61-0b178640f281 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:09.041330 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ca68274c-7551-4293-bb61-0b178640f281 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 28645 microversion: 2.20 time: 0.095356 Jan 18 20:28:09.042050 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 353/698] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:08 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 28645 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:28:09.572066 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-46baaced-f068-45e8-8cd2-f10cf49d2451 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:09.573109 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-46baaced-f068-45e8-8cd2-f10cf49d2451 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:09.580652 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-46baaced-f068-45e8-8cd2-f10cf49d2451 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:09.581097 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-46baaced-f068-45e8-8cd2-f10cf49d2451 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:09.581878 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-46baaced-f068-45e8-8cd2-f10cf49d2451 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:09.582313 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-46baaced-f068-45e8-8cd2-f10cf49d2451 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:09.656543 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-46baaced-f068-45e8-8cd2-f10cf49d2451 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 15025 microversion: 2.1 time: 0.088570 Jan 18 20:28:09.657184 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 346/699] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:09 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 15025 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:10.054769 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6d1ae39b-1180-4155-96f6-77856858c976 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:10.055798 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6d1ae39b-1180-4155-96f6-77856858c976 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:10.063521 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6d1ae39b-1180-4155-96f6-77856858c976 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:10.063978 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6d1ae39b-1180-4155-96f6-77856858c976 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:10.064779 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6d1ae39b-1180-4155-96f6-77856858c976 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:10.065219 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6d1ae39b-1180-4155-96f6-77856858c976 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:10.137819 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6d1ae39b-1180-4155-96f6-77856858c976 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 28645 microversion: 2.20 time: 0.086399 Jan 18 20:28:10.138429 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 354/700] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:10 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 28645 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:10.670288 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-513e9627-db0e-42f6-bfb3-446a712b043d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:10.671606 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-513e9627-db0e-42f6-bfb3-446a712b043d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:10.679108 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-513e9627-db0e-42f6-bfb3-446a712b043d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:10.679553 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-513e9627-db0e-42f6-bfb3-446a712b043d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:10.680340 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-513e9627-db0e-42f6-bfb3-446a712b043d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:10.680777 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-513e9627-db0e-42f6-bfb3-446a712b043d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:10.776264 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-513e9627-db0e-42f6-bfb3-446a712b043d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 18155 microversion: 2.1 time: 0.111663 Jan 18 20:28:10.776929 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 347/701] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:10 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 18155 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:11.151519 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-97520b9f-fb18-4843-bef5-a0d0c16e1b0a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:11.153076 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-97520b9f-fb18-4843-bef5-a0d0c16e1b0a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:11.160111 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-97520b9f-fb18-4843-bef5-a0d0c16e1b0a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:11.160555 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-97520b9f-fb18-4843-bef5-a0d0c16e1b0a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:11.161330 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-97520b9f-fb18-4843-bef5-a0d0c16e1b0a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:11.161761 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-97520b9f-fb18-4843-bef5-a0d0c16e1b0a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:11.227548 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-97520b9f-fb18-4843-bef5-a0d0c16e1b0a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 28645 microversion: 2.20 time: 0.079823 Jan 18 20:28:11.228213 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 355/702] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:11 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 28645 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:11.789661 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-9d4486e8-6a30-45a3-85ac-938b3a8e0e49 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:11.790692 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-9d4486e8-6a30-45a3-85ac-938b3a8e0e49 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:11.798625 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9d4486e8-6a30-45a3-85ac-938b3a8e0e49 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:11.799110 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9d4486e8-6a30-45a3-85ac-938b3a8e0e49 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:11.799945 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9d4486e8-6a30-45a3-85ac-938b3a8e0e49 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:11.800386 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9d4486e8-6a30-45a3-85ac-938b3a8e0e49 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:11.887200 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-9d4486e8-6a30-45a3-85ac-938b3a8e0e49 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 19342 microversion: 2.1 time: 0.101378 Jan 18 20:28:11.887862 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 348/703] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:11 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 19342 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:12.243508 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d014c635-f4fd-4fb7-9730-5dac9d743cfe tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:12.244507 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d014c635-f4fd-4fb7-9730-5dac9d743cfe tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:12.251949 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d014c635-f4fd-4fb7-9730-5dac9d743cfe tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:12.252396 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d014c635-f4fd-4fb7-9730-5dac9d743cfe tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:12.253178 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d014c635-f4fd-4fb7-9730-5dac9d743cfe tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:12.253606 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d014c635-f4fd-4fb7-9730-5dac9d743cfe tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:12.320441 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d014c635-f4fd-4fb7-9730-5dac9d743cfe tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 28645 microversion: 2.20 time: 0.081557 Jan 18 20:28:12.321098 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 356/704] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:12 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 28645 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:12.899654 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f0fb5d4f-2951-449f-8c16-3e304656626a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:12.900710 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-f0fb5d4f-2951-449f-8c16-3e304656626a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:12.909000 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f0fb5d4f-2951-449f-8c16-3e304656626a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:12.909446 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f0fb5d4f-2951-449f-8c16-3e304656626a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:12.910310 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f0fb5d4f-2951-449f-8c16-3e304656626a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:12.910738 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f0fb5d4f-2951-449f-8c16-3e304656626a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:12.998752 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-f0fb5d4f-2951-449f-8c16-3e304656626a tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 21519 microversion: 2.1 time: 0.103153 Jan 18 20:28:12.999412 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 349/705] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:12 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 21519 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:13.332862 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-aa91b39d-3102-40ff-a8c9-ac6bcc1676a4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:13.333875 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-aa91b39d-3102-40ff-a8c9-ac6bcc1676a4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:13.340961 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aa91b39d-3102-40ff-a8c9-ac6bcc1676a4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:13.341414 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aa91b39d-3102-40ff-a8c9-ac6bcc1676a4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:13.342213 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aa91b39d-3102-40ff-a8c9-ac6bcc1676a4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:13.342652 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aa91b39d-3102-40ff-a8c9-ac6bcc1676a4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:13.443516 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-aa91b39d-3102-40ff-a8c9-ac6bcc1676a4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 29006 microversion: 2.20 time: 0.114467 Jan 18 20:28:13.444176 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 357/706] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:13 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 29006 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:14.011645 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-292cc669-9ff0-4de4-bbb7-3dd94027d5e3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:14.012657 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-292cc669-9ff0-4de4-bbb7-3dd94027d5e3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:14.019727 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-292cc669-9ff0-4de4-bbb7-3dd94027d5e3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:14.020181 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-292cc669-9ff0-4de4-bbb7-3dd94027d5e3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:14.020978 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-292cc669-9ff0-4de4-bbb7-3dd94027d5e3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:14.021419 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-292cc669-9ff0-4de4-bbb7-3dd94027d5e3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:14.103648 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-292cc669-9ff0-4de4-bbb7-3dd94027d5e3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 23137 microversion: 2.1 time: 0.096204 Jan 18 20:28:14.104356 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 350/707] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:14 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 23137 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:14.457917 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-953053ac-4788-40b8-beb3-5a49b37df0aa tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:14.458830 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-953053ac-4788-40b8-beb3-5a49b37df0aa tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:14.465888 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-953053ac-4788-40b8-beb3-5a49b37df0aa tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:14.466336 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-953053ac-4788-40b8-beb3-5a49b37df0aa tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:14.467146 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-953053ac-4788-40b8-beb3-5a49b37df0aa tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:14.467585 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-953053ac-4788-40b8-beb3-5a49b37df0aa tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:14.548757 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-953053ac-4788-40b8-beb3-5a49b37df0aa tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 30630 microversion: 2.20 time: 0.094802 Jan 18 20:28:14.549416 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 358/708] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:14 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 30630 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:15.114895 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-72b0d4fc-7ab1-4c02-9fa1-4775e3f5d3e8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:15.115804 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-72b0d4fc-7ab1-4c02-9fa1-4775e3f5d3e8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:15.123267 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-72b0d4fc-7ab1-4c02-9fa1-4775e3f5d3e8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:15.123749 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-72b0d4fc-7ab1-4c02-9fa1-4775e3f5d3e8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:15.124578 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-72b0d4fc-7ab1-4c02-9fa1-4775e3f5d3e8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:15.124998 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-72b0d4fc-7ab1-4c02-9fa1-4775e3f5d3e8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:15.207753 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-72b0d4fc-7ab1-4c02-9fa1-4775e3f5d3e8 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 24398 microversion: 2.1 time: 0.096565 Jan 18 20:28:15.208465 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 351/709] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:15 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 24398 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:15.560176 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8b130a95-959f-406a-b2d4-6aa80eb7ed5b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:15.561177 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8b130a95-959f-406a-b2d4-6aa80eb7ed5b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:15.568007 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8b130a95-959f-406a-b2d4-6aa80eb7ed5b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:15.568449 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8b130a95-959f-406a-b2d4-6aa80eb7ed5b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:15.569213 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8b130a95-959f-406a-b2d4-6aa80eb7ed5b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:15.569635 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8b130a95-959f-406a-b2d4-6aa80eb7ed5b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:15.648167 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8b130a95-959f-406a-b2d4-6aa80eb7ed5b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 32126 microversion: 2.20 time: 0.091931 Jan 18 20:28:15.648837 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 359/710] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:15 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 32126 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:16.221531 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-91746ec0-26e5-44ef-9df8-64776ab825bb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:16.222459 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-91746ec0-26e5-44ef-9df8-64776ab825bb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:16.229451 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-91746ec0-26e5-44ef-9df8-64776ab825bb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:16.229922 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-91746ec0-26e5-44ef-9df8-64776ab825bb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:16.230696 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-91746ec0-26e5-44ef-9df8-64776ab825bb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:16.231182 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-91746ec0-26e5-44ef-9df8-64776ab825bb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:16.308701 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-91746ec0-26e5-44ef-9df8-64776ab825bb tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 25605 microversion: 2.1 time: 0.091019 Jan 18 20:28:16.309359 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 352/711] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:16 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 25605 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:16.660756 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b1d346d8-5bcd-4028-a476-20013c7e9e59 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:16.661753 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b1d346d8-5bcd-4028-a476-20013c7e9e59 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:16.669299 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b1d346d8-5bcd-4028-a476-20013c7e9e59 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:16.669749 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b1d346d8-5bcd-4028-a476-20013c7e9e59 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:16.670533 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b1d346d8-5bcd-4028-a476-20013c7e9e59 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:16.670970 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b1d346d8-5bcd-4028-a476-20013c7e9e59 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:16.755507 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b1d346d8-5bcd-4028-a476-20013c7e9e59 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 33139 microversion: 2.20 time: 0.098614 Jan 18 20:28:16.756176 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 360/712] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:16 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 33139 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:17.320706 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-3566a3e6-1a50-4d95-b685-384b58dcc637 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:17.321700 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-3566a3e6-1a50-4d95-b685-384b58dcc637 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:17.329481 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3566a3e6-1a50-4d95-b685-384b58dcc637 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:17.329920 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3566a3e6-1a50-4d95-b685-384b58dcc637 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:17.330719 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3566a3e6-1a50-4d95-b685-384b58dcc637 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:17.331182 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3566a3e6-1a50-4d95-b685-384b58dcc637 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:17.415284 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-3566a3e6-1a50-4d95-b685-384b58dcc637 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 26786 microversion: 2.1 time: 0.098241 Jan 18 20:28:17.415888 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 353/713] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:17 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 26786 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:17.768519 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-590f6f7a-95b9-44b0-b024-31a49e185581 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:17.769438 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-590f6f7a-95b9-44b0-b024-31a49e185581 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:17.776384 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-590f6f7a-95b9-44b0-b024-31a49e185581 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:17.776828 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-590f6f7a-95b9-44b0-b024-31a49e185581 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:17.777620 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-590f6f7a-95b9-44b0-b024-31a49e185581 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:17.778084 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-590f6f7a-95b9-44b0-b024-31a49e185581 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:17.865857 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-590f6f7a-95b9-44b0-b024-31a49e185581 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 33857 microversion: 2.20 time: 0.101315 Jan 18 20:28:17.866509 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 361/714] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:17 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 33857 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:18.583239 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0e206a73-5416-44ed-9d3b-601e5dd88a56 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:18.584897 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0e206a73-5416-44ed-9d3b-601e5dd88a56 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:18.591902 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0e206a73-5416-44ed-9d3b-601e5dd88a56 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:18.592348 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0e206a73-5416-44ed-9d3b-601e5dd88a56 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:18.593138 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0e206a73-5416-44ed-9d3b-601e5dd88a56 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:18.593567 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0e206a73-5416-44ed-9d3b-601e5dd88a56 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:18.677775 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0e206a73-5416-44ed-9d3b-601e5dd88a56 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 27606 microversion: 2.1 time: 0.253732 Jan 18 20:28:18.678466 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 354/715] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:18 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 27606 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:18.878533 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-355d5bd3-5e43-4cd8-9eec-bc0ddbd48fae tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:18.879599 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-355d5bd3-5e43-4cd8-9eec-bc0ddbd48fae tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:18.887169 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-355d5bd3-5e43-4cd8-9eec-bc0ddbd48fae tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:18.887621 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-355d5bd3-5e43-4cd8-9eec-bc0ddbd48fae tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:18.888403 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-355d5bd3-5e43-4cd8-9eec-bc0ddbd48fae tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:18.888835 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-355d5bd3-5e43-4cd8-9eec-bc0ddbd48fae tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:18.975604 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-355d5bd3-5e43-4cd8-9eec-bc0ddbd48fae tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 34697 microversion: 2.20 time: 0.100951 Jan 18 20:28:18.976287 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 362/716] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:18 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 34697 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:19.690690 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d4d1a9a3-59da-4ff8-8050-ae62538a0b8c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:19.691750 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d4d1a9a3-59da-4ff8-8050-ae62538a0b8c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:19.698638 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d4d1a9a3-59da-4ff8-8050-ae62538a0b8c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:19.699115 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d4d1a9a3-59da-4ff8-8050-ae62538a0b8c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:19.699929 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d4d1a9a3-59da-4ff8-8050-ae62538a0b8c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:19.700383 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d4d1a9a3-59da-4ff8-8050-ae62538a0b8c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:19.793706 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d4d1a9a3-59da-4ff8-8050-ae62538a0b8c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 27976 microversion: 2.1 time: 0.106953 Jan 18 20:28:19.794341 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 355/717] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:19 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 27976 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:19.989146 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-179425dd-396f-42b0-81f3-66584c8caab9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:19.990063 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-179425dd-396f-42b0-81f3-66584c8caab9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:19.997633 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-179425dd-396f-42b0-81f3-66584c8caab9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:19.998083 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-179425dd-396f-42b0-81f3-66584c8caab9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:19.998879 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-179425dd-396f-42b0-81f3-66584c8caab9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:19.999347 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-179425dd-396f-42b0-81f3-66584c8caab9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:20.083519 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-179425dd-396f-42b0-81f3-66584c8caab9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 35410 microversion: 2.20 time: 0.098360 Jan 18 20:28:20.084164 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 363/718] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:19 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 35410 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:20.805635 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-dc0ccf50-f50d-4ed6-ae35-fa12dc99e834 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:20.806643 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-dc0ccf50-f50d-4ed6-ae35-fa12dc99e834 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:20.813614 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dc0ccf50-f50d-4ed6-ae35-fa12dc99e834 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:20.814069 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dc0ccf50-f50d-4ed6-ae35-fa12dc99e834 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:20.814848 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dc0ccf50-f50d-4ed6-ae35-fa12dc99e834 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:20.815318 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-dc0ccf50-f50d-4ed6-ae35-fa12dc99e834 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:20.893376 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-dc0ccf50-f50d-4ed6-ae35-fa12dc99e834 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 28212 microversion: 2.1 time: 0.091944 Jan 18 20:28:20.894020 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 356/719] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:20 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 28212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:21.096789 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-623bd96a-7a0f-4753-9f86-3d719aed8200 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:21.097921 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-623bd96a-7a0f-4753-9f86-3d719aed8200 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:21.105678 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-623bd96a-7a0f-4753-9f86-3d719aed8200 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:21.106131 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-623bd96a-7a0f-4753-9f86-3d719aed8200 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:21.106931 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-623bd96a-7a0f-4753-9f86-3d719aed8200 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:21.107393 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-623bd96a-7a0f-4753-9f86-3d719aed8200 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:21.182189 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-623bd96a-7a0f-4753-9f86-3d719aed8200 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 36425 microversion: 2.20 time: 0.089275 Jan 18 20:28:21.183766 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 364/720] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:21 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 36425 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:28:21.906088 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-02d6481b-24a4-40c4-96c9-5117fe10fd2c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:21.907163 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-02d6481b-24a4-40c4-96c9-5117fe10fd2c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:21.914028 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-02d6481b-24a4-40c4-96c9-5117fe10fd2c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:21.914479 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-02d6481b-24a4-40c4-96c9-5117fe10fd2c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:21.915292 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-02d6481b-24a4-40c4-96c9-5117fe10fd2c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:21.915733 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-02d6481b-24a4-40c4-96c9-5117fe10fd2c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:21.983417 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-02d6481b-24a4-40c4-96c9-5117fe10fd2c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 28212 microversion: 2.1 time: 0.081172 Jan 18 20:28:21.984038 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 357/721] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:21 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 28212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:22.194794 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1b472793-4e7a-4150-a64c-a7941ab63538 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:22.195764 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1b472793-4e7a-4150-a64c-a7941ab63538 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:22.202601 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b472793-4e7a-4150-a64c-a7941ab63538 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:22.203071 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b472793-4e7a-4150-a64c-a7941ab63538 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:22.203844 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b472793-4e7a-4150-a64c-a7941ab63538 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:22.204275 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b472793-4e7a-4150-a64c-a7941ab63538 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:22.289313 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1b472793-4e7a-4150-a64c-a7941ab63538 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 37436 microversion: 2.20 time: 0.098523 Jan 18 20:28:22.289975 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 365/722] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:22 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 37436 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:22.995863 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-2f95b794-d05f-4b7f-a927-dd2e83935530 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:22.996779 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-2f95b794-d05f-4b7f-a927-dd2e83935530 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:23.003677 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2f95b794-d05f-4b7f-a927-dd2e83935530 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:23.004119 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2f95b794-d05f-4b7f-a927-dd2e83935530 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:23.004893 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2f95b794-d05f-4b7f-a927-dd2e83935530 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:23.005322 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2f95b794-d05f-4b7f-a927-dd2e83935530 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:23.092237 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2f95b794-d05f-4b7f-a927-dd2e83935530 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 28502 microversion: 2.1 time: 0.100836 Jan 18 20:28:23.092892 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 358/723] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:22 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 28502 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:23.302746 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3efd2b8e-15c7-480c-bce7-4b3ff2018383 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:23.303786 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3efd2b8e-15c7-480c-bce7-4b3ff2018383 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:23.310705 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3efd2b8e-15c7-480c-bce7-4b3ff2018383 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:23.311184 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3efd2b8e-15c7-480c-bce7-4b3ff2018383 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:23.311977 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3efd2b8e-15c7-480c-bce7-4b3ff2018383 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:23.312484 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3efd2b8e-15c7-480c-bce7-4b3ff2018383 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:23.394891 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3efd2b8e-15c7-480c-bce7-4b3ff2018383 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 38198 microversion: 2.20 time: 0.096139 Jan 18 20:28:23.395900 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 366/724] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:23 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 38198 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:24.104215 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ac033ec4-e956-4899-84d3-5b15ce4edda4 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:24.105639 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ac033ec4-e956-4899-84d3-5b15ce4edda4 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:24.112467 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ac033ec4-e956-4899-84d3-5b15ce4edda4 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:24.112922 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ac033ec4-e956-4899-84d3-5b15ce4edda4 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:24.113703 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ac033ec4-e956-4899-84d3-5b15ce4edda4 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:24.114141 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ac033ec4-e956-4899-84d3-5b15ce4edda4 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:24.192827 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ac033ec4-e956-4899-84d3-5b15ce4edda4 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 28670 microversion: 2.1 time: 0.092475 Jan 18 20:28:24.193518 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 359/725] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:24 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 28670 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:24.407532 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c7da2b52-54dc-42c3-852f-12d678efa024 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:24.408450 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c7da2b52-54dc-42c3-852f-12d678efa024 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:24.415387 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7da2b52-54dc-42c3-852f-12d678efa024 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:24.415839 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7da2b52-54dc-42c3-852f-12d678efa024 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:24.416615 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7da2b52-54dc-42c3-852f-12d678efa024 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:24.417052 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7da2b52-54dc-42c3-852f-12d678efa024 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:24.478963 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c7da2b52-54dc-42c3-852f-12d678efa024 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 38198 microversion: 2.20 time: 0.075478 Jan 18 20:28:24.479616 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 367/726] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:24 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 38198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:28:25.205718 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-472feb86-2c38-4759-b1ff-6d4c27d5ddb5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:25.206717 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-472feb86-2c38-4759-b1ff-6d4c27d5ddb5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:25.213613 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-472feb86-2c38-4759-b1ff-6d4c27d5ddb5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:25.214066 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-472feb86-2c38-4759-b1ff-6d4c27d5ddb5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:25.214848 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-472feb86-2c38-4759-b1ff-6d4c27d5ddb5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:25.215318 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-472feb86-2c38-4759-b1ff-6d4c27d5ddb5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:25.275589 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-472feb86-2c38-4759-b1ff-6d4c27d5ddb5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 28670 microversion: 2.1 time: 0.073781 Jan 18 20:28:25.276235 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 360/727] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:25 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 28670 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:25.491441 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1ecfd86d-fda1-43fe-8aaf-e7dd53f7a5bf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:25.492359 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1ecfd86d-fda1-43fe-8aaf-e7dd53f7a5bf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:25.499237 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ecfd86d-fda1-43fe-8aaf-e7dd53f7a5bf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:25.499685 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ecfd86d-fda1-43fe-8aaf-e7dd53f7a5bf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:25.500453 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ecfd86d-fda1-43fe-8aaf-e7dd53f7a5bf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:25.500884 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ecfd86d-fda1-43fe-8aaf-e7dd53f7a5bf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:25.565657 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1ecfd86d-fda1-43fe-8aaf-e7dd53f7a5bf tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 38198 microversion: 2.20 time: 0.078257 Jan 18 20:28:25.566287 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 368/728] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:25 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 38198 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:26.287964 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e1145606-9a3f-4ecf-aaaa-dd843c3d3fb3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:26.288867 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e1145606-9a3f-4ecf-aaaa-dd843c3d3fb3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:26.296511 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e1145606-9a3f-4ecf-aaaa-dd843c3d3fb3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:26.296950 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e1145606-9a3f-4ecf-aaaa-dd843c3d3fb3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:26.297985 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e1145606-9a3f-4ecf-aaaa-dd843c3d3fb3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:26.298413 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e1145606-9a3f-4ecf-aaaa-dd843c3d3fb3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:26.365814 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e1145606-9a3f-4ecf-aaaa-dd843c3d3fb3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 28670 microversion: 2.1 time: 0.081817 Jan 18 20:28:26.366707 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 361/729] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:26 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 28670 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:28:26.578706 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2bd4209d-bb57-41e0-ac32-c3d064967d1e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:26.579756 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2bd4209d-bb57-41e0-ac32-c3d064967d1e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:26.586629 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bd4209d-bb57-41e0-ac32-c3d064967d1e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:26.587100 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bd4209d-bb57-41e0-ac32-c3d064967d1e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:26.587877 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bd4209d-bb57-41e0-ac32-c3d064967d1e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:26.588664 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bd4209d-bb57-41e0-ac32-c3d064967d1e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:26.668981 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2bd4209d-bb57-41e0-ac32-c3d064967d1e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 200 len: 38339 microversion: 2.20 time: 0.094223 Jan 18 20:28:26.669599 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 369/730] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:26 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 38339 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:26.680010 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f5df2567-1db9-45b5-9ce4-201f33e67f23 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:26.680588 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-f5df2567-1db9-45b5-9ce4-201f33e67f23 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:26.687402 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f5df2567-1db9-45b5-9ce4-201f33e67f23 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:26.687845 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f5df2567-1db9-45b5-9ce4-201f33e67f23 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:26.688606 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f5df2567-1db9-45b5-9ce4-201f33e67f23 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:26.689033 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f5df2567-1db9-45b5-9ce4-201f33e67f23 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:26.713710 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-f5df2567-1db9-45b5-9ce4-201f33e67f23 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/ips" status: 200 len: 151 microversion: 2.20 time: 0.037675 Jan 18 20:28:26.714791 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 362/731] 10.222.0.67 () {60 vars in 1288 bytes} [Tue Jan 18 20:28:26 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:27.377808 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5278b3c1-0f37-4191-89b2-3cbed21ba7d3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:27.378875 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5278b3c1-0f37-4191-89b2-3cbed21ba7d3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:27.385753 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5278b3c1-0f37-4191-89b2-3cbed21ba7d3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:27.386862 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5278b3c1-0f37-4191-89b2-3cbed21ba7d3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:27.387701 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5278b3c1-0f37-4191-89b2-3cbed21ba7d3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:27.388133 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5278b3c1-0f37-4191-89b2-3cbed21ba7d3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:27.453311 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5278b3c1-0f37-4191-89b2-3cbed21ba7d3 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 28670 microversion: 2.1 time: 0.079377 Jan 18 20:28:27.453934 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 370/732] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:27 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 28670 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:28.464944 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e89bfffd-6b61-40fa-8dab-d93e9feb527f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:28.465771 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e89bfffd-6b61-40fa-8dab-d93e9feb527f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:28.472061 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e89bfffd-6b61-40fa-8dab-d93e9feb527f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:28.472511 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e89bfffd-6b61-40fa-8dab-d93e9feb527f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:28.473286 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e89bfffd-6b61-40fa-8dab-d93e9feb527f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:28.473727 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e89bfffd-6b61-40fa-8dab-d93e9feb527f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:28.562232 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e89bfffd-6b61-40fa-8dab-d93e9feb527f tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 29822 microversion: 2.1 time: 0.100952 Jan 18 20:28:28.562897 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 363/733] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:28 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 29822 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:29.073233 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a8264bf1-d09a-4b37-8094-b3810b89fb69 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:29.074494 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a8264bf1-d09a-4b37-8094-b3810b89fb69 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:29.081402 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a8264bf1-d09a-4b37-8094-b3810b89fb69 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:29.081855 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a8264bf1-d09a-4b37-8094-b3810b89fb69 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:29.082634 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a8264bf1-d09a-4b37-8094-b3810b89fb69 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:29.083100 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a8264bf1-d09a-4b37-8094-b3810b89fb69 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:29.108114 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-a8264bf1-d09a-4b37-8094-b3810b89fb69 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lazy-loading 'flavor' on Instance uuid c6d0afa1-510c-4954-8984-662702bb00dc {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:28:29.484858 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a8264bf1-d09a-4b37-8094-b3810b89fb69 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 202 len: 0 microversion: 2.20 time: 0.415562 Jan 18 20:28:29.486908 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 371/734] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:28:29 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:28:29.493852 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-1b478275-25be-4f7e-a19e-6ba84fa275c6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:29.494546 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-1b478275-25be-4f7e-a19e-6ba84fa275c6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:29.501954 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1b478275-25be-4f7e-a19e-6ba84fa275c6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:29.502438 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1b478275-25be-4f7e-a19e-6ba84fa275c6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:29.503402 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1b478275-25be-4f7e-a19e-6ba84fa275c6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:29.504014 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1b478275-25be-4f7e-a19e-6ba84fa275c6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:29.574610 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e2995ab0-77bc-4403-a1e4-40098cd11084 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:29.575696 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e2995ab0-77bc-4403-a1e4-40098cd11084 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:29.581906 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e2995ab0-77bc-4403-a1e4-40098cd11084 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:29.583267 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e2995ab0-77bc-4403-a1e4-40098cd11084 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:29.584118 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e2995ab0-77bc-4403-a1e4-40098cd11084 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:29.584551 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e2995ab0-77bc-4403-a1e4-40098cd11084 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:29.669153 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e2995ab0-77bc-4403-a1e4-40098cd11084 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 31447 microversion: 2.1 time: 0.098832 Jan 18 20:28:29.670577 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 372/735] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:29 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 31447 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:29.690770 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-1b478275-25be-4f7e-a19e-6ba84fa275c6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:29.699257 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-1b478275-25be-4f7e-a19e-6ba84fa275c6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:29.700767 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-1b478275-25be-4f7e-a19e-6ba84fa275c6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:29.701926 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-1b478275-25be-4f7e-a19e-6ba84fa275c6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1722 microversion: 2.20 time: 0.212094 Jan 18 20:28:29.702485 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 364/736] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:29 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:30.681594 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2a8b8d7b-c5dd-4ef2-aabe-af4977b2f69c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:30.682635 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2a8b8d7b-c5dd-4ef2-aabe-af4977b2f69c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:30.690001 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2a8b8d7b-c5dd-4ef2-aabe-af4977b2f69c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:30.690451 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2a8b8d7b-c5dd-4ef2-aabe-af4977b2f69c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:30.691275 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2a8b8d7b-c5dd-4ef2-aabe-af4977b2f69c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:30.691711 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2a8b8d7b-c5dd-4ef2-aabe-af4977b2f69c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:30.721876 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-282f7606-d68b-46cd-9e67-430e78eca304 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:30.722500 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-282f7606-d68b-46cd-9e67-430e78eca304 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:30.728860 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-282f7606-d68b-46cd-9e67-430e78eca304 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:30.729303 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-282f7606-d68b-46cd-9e67-430e78eca304 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:30.730074 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-282f7606-d68b-46cd-9e67-430e78eca304 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:30.730507 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-282f7606-d68b-46cd-9e67-430e78eca304 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:30.772230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2a8b8d7b-c5dd-4ef2-aabe-af4977b2f69c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 32927 microversion: 2.1 time: 0.094483 Jan 18 20:28:30.773040 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 373/737] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:30 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 32927 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:30.863955 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-282f7606-d68b-46cd-9e67-430e78eca304 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:30.871535 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-282f7606-d68b-46cd-9e67-430e78eca304 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:30.873024 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-282f7606-d68b-46cd-9e67-430e78eca304 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:30.874160 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-282f7606-d68b-46cd-9e67-430e78eca304 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1722 microversion: 2.20 time: 0.157145 Jan 18 20:28:30.874711 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 365/738] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:30 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:28:31.784538 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-95a4c2e9-281f-4b08-a009-de882bd51db7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:31.785536 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-95a4c2e9-281f-4b08-a009-de882bd51db7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:31.792443 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-95a4c2e9-281f-4b08-a009-de882bd51db7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:31.792895 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-95a4c2e9-281f-4b08-a009-de882bd51db7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:31.793715 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-95a4c2e9-281f-4b08-a009-de882bd51db7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:31.794163 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-95a4c2e9-281f-4b08-a009-de882bd51db7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:31.872407 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-95a4c2e9-281f-4b08-a009-de882bd51db7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 33774 microversion: 2.1 time: 0.091149 Jan 18 20:28:31.873094 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 374/739] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:31 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 33774 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:28:31.892893 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-18db7f26-8aa1-498d-a03c-ba5f67d7801a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:31.893498 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-18db7f26-8aa1-498d-a03c-ba5f67d7801a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:31.899980 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-18db7f26-8aa1-498d-a03c-ba5f67d7801a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:31.900424 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-18db7f26-8aa1-498d-a03c-ba5f67d7801a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:31.901282 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-18db7f26-8aa1-498d-a03c-ba5f67d7801a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:31.901653 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-18db7f26-8aa1-498d-a03c-ba5f67d7801a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:32.028469 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-18db7f26-8aa1-498d-a03c-ba5f67d7801a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:32.036304 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-18db7f26-8aa1-498d-a03c-ba5f67d7801a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:32.037742 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-18db7f26-8aa1-498d-a03c-ba5f67d7801a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:32.039258 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-18db7f26-8aa1-498d-a03c-ba5f67d7801a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1722 microversion: 2.20 time: 0.150045 Jan 18 20:28:32.039823 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 366/740] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:31 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:28:32.884597 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-05964e76-972d-4c5c-8508-258c22f22703 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:32.885633 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-05964e76-972d-4c5c-8508-258c22f22703 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:32.892564 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05964e76-972d-4c5c-8508-258c22f22703 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:32.893001 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05964e76-972d-4c5c-8508-258c22f22703 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:32.893767 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05964e76-972d-4c5c-8508-258c22f22703 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:32.894197 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05964e76-972d-4c5c-8508-258c22f22703 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:32.973825 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-05964e76-972d-4c5c-8508-258c22f22703 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 34931 microversion: 2.1 time: 0.092940 Jan 18 20:28:32.974387 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 375/741] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:32 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 34931 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:33.057795 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-828f90c9-bd04-4ae0-a3d6-dd45359de0e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:33.058433 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-828f90c9-bd04-4ae0-a3d6-dd45359de0e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:33.065426 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-828f90c9-bd04-4ae0-a3d6-dd45359de0e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:33.065879 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-828f90c9-bd04-4ae0-a3d6-dd45359de0e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:33.066659 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-828f90c9-bd04-4ae0-a3d6-dd45359de0e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:33.067137 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-828f90c9-bd04-4ae0-a3d6-dd45359de0e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:33.196987 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-828f90c9-bd04-4ae0-a3d6-dd45359de0e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:33.205380 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-828f90c9-bd04-4ae0-a3d6-dd45359de0e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:33.206874 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-828f90c9-bd04-4ae0-a3d6-dd45359de0e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:33.208051 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-828f90c9-bd04-4ae0-a3d6-dd45359de0e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1722 microversion: 2.20 time: 0.154011 Jan 18 20:28:33.208612 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 367/742] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:33 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:33.988909 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f6f15e44-38d5-47f1-ba19-04be841e17a5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:33.989930 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f6f15e44-38d5-47f1-ba19-04be841e17a5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:33.996797 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f6f15e44-38d5-47f1-ba19-04be841e17a5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:33.997244 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f6f15e44-38d5-47f1-ba19-04be841e17a5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:33.998023 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f6f15e44-38d5-47f1-ba19-04be841e17a5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:33.998450 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f6f15e44-38d5-47f1-ba19-04be841e17a5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:34.072879 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f6f15e44-38d5-47f1-ba19-04be841e17a5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 36032 microversion: 2.1 time: 0.087796 Jan 18 20:28:34.073532 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 376/743] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:33 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 36032 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:28:34.226035 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-18c8f2e1-b3ba-48fb-9a5d-b94cd134066a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:34.226590 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-18c8f2e1-b3ba-48fb-9a5d-b94cd134066a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:34.233676 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-18c8f2e1-b3ba-48fb-9a5d-b94cd134066a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:34.234119 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-18c8f2e1-b3ba-48fb-9a5d-b94cd134066a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:34.234903 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-18c8f2e1-b3ba-48fb-9a5d-b94cd134066a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:34.235368 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-18c8f2e1-b3ba-48fb-9a5d-b94cd134066a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:34.368751 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-18c8f2e1-b3ba-48fb-9a5d-b94cd134066a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:34.376503 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-18c8f2e1-b3ba-48fb-9a5d-b94cd134066a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:34.377985 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-18c8f2e1-b3ba-48fb-9a5d-b94cd134066a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:34.379234 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-18c8f2e1-b3ba-48fb-9a5d-b94cd134066a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1722 microversion: 2.20 time: 0.156957 Jan 18 20:28:34.379795 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 368/744] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:34 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:35.085326 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-910dbef0-dc6e-4929-9ddf-4b4846912e50 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:35.086333 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-910dbef0-dc6e-4929-9ddf-4b4846912e50 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:35.093802 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-910dbef0-dc6e-4929-9ddf-4b4846912e50 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:35.094247 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-910dbef0-dc6e-4929-9ddf-4b4846912e50 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:35.095024 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-910dbef0-dc6e-4929-9ddf-4b4846912e50 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:35.095475 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-910dbef0-dc6e-4929-9ddf-4b4846912e50 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:35.168960 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-910dbef0-dc6e-4929-9ddf-4b4846912e50 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 37574 microversion: 2.1 time: 0.086549 Jan 18 20:28:35.169212 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 377/745] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:35 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 37574 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:35.397297 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ae17b6fb-6a45-4f1b-ab40-7c9fbb81bc04 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:35.397832 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ae17b6fb-6a45-4f1b-ab40-7c9fbb81bc04 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:35.404590 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ae17b6fb-6a45-4f1b-ab40-7c9fbb81bc04 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:35.405033 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ae17b6fb-6a45-4f1b-ab40-7c9fbb81bc04 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:35.405792 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ae17b6fb-6a45-4f1b-ab40-7c9fbb81bc04 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:35.406220 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ae17b6fb-6a45-4f1b-ab40-7c9fbb81bc04 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:35.535945 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-ae17b6fb-6a45-4f1b-ab40-7c9fbb81bc04 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:35.544396 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-ae17b6fb-6a45-4f1b-ab40-7c9fbb81bc04 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:35.545904 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-ae17b6fb-6a45-4f1b-ab40-7c9fbb81bc04 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:35.547331 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ae17b6fb-6a45-4f1b-ab40-7c9fbb81bc04 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1722 microversion: 2.20 time: 0.153603 Jan 18 20:28:35.547889 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 369/746] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:35 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:36.183353 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-227a8522-2a0a-47fe-bd0d-481220a1bf92 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:36.184864 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-227a8522-2a0a-47fe-bd0d-481220a1bf92 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:36.191720 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-227a8522-2a0a-47fe-bd0d-481220a1bf92 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:36.192166 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-227a8522-2a0a-47fe-bd0d-481220a1bf92 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:36.192927 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-227a8522-2a0a-47fe-bd0d-481220a1bf92 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:36.193358 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-227a8522-2a0a-47fe-bd0d-481220a1bf92 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:36.266760 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-227a8522-2a0a-47fe-bd0d-481220a1bf92 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 38195 microversion: 2.1 time: 0.087043 Jan 18 20:28:36.267324 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 378/747] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:36 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 38195 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:36.565627 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-bf758bf2-9a79-4d35-9116-7f6f3e34641d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:36.566235 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-bf758bf2-9a79-4d35-9116-7f6f3e34641d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:36.572493 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bf758bf2-9a79-4d35-9116-7f6f3e34641d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:36.572940 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bf758bf2-9a79-4d35-9116-7f6f3e34641d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:36.573703 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bf758bf2-9a79-4d35-9116-7f6f3e34641d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:36.574473 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bf758bf2-9a79-4d35-9116-7f6f3e34641d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:36.705285 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-bf758bf2-9a79-4d35-9116-7f6f3e34641d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:36.713091 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-bf758bf2-9a79-4d35-9116-7f6f3e34641d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:36.714583 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-bf758bf2-9a79-4d35-9116-7f6f3e34641d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:36.715768 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-bf758bf2-9a79-4d35-9116-7f6f3e34641d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1722 microversion: 2.20 time: 0.153846 Jan 18 20:28:36.716330 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 370/748] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:36 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:37.279761 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4dc95c81-5d20-47bc-94a6-16870e8cb445 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:37.280656 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4dc95c81-5d20-47bc-94a6-16870e8cb445 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:37.287531 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4dc95c81-5d20-47bc-94a6-16870e8cb445 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:37.287974 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4dc95c81-5d20-47bc-94a6-16870e8cb445 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:37.288740 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4dc95c81-5d20-47bc-94a6-16870e8cb445 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:37.289165 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4dc95c81-5d20-47bc-94a6-16870e8cb445 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:37.356190 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4dc95c81-5d20-47bc-94a6-16870e8cb445 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 38195 microversion: 2.1 time: 0.081087 Jan 18 20:28:37.356852 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 379/749] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:37 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 38195 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:37.733794 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fb20003f-17c3-40c8-8bba-e1ad9720c08e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:37.734421 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-fb20003f-17c3-40c8-8bba-e1ad9720c08e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:37.740840 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fb20003f-17c3-40c8-8bba-e1ad9720c08e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:37.741285 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fb20003f-17c3-40c8-8bba-e1ad9720c08e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:37.742056 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fb20003f-17c3-40c8-8bba-e1ad9720c08e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:37.742485 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fb20003f-17c3-40c8-8bba-e1ad9720c08e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:37.877173 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-fb20003f-17c3-40c8-8bba-e1ad9720c08e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:37.885322 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-fb20003f-17c3-40c8-8bba-e1ad9720c08e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:37.887863 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-fb20003f-17c3-40c8-8bba-e1ad9720c08e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:37.889205 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-fb20003f-17c3-40c8-8bba-e1ad9720c08e tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1722 microversion: 2.20 time: 0.159032 Jan 18 20:28:37.889840 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 371/750] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:37 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:38.368730 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a3e8d8e4-cc0e-48c6-b839-5aa704fc27ca tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:38.369733 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a3e8d8e4-cc0e-48c6-b839-5aa704fc27ca tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:38.377497 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3e8d8e4-cc0e-48c6-b839-5aa704fc27ca tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:38.377944 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3e8d8e4-cc0e-48c6-b839-5aa704fc27ca tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:38.378729 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3e8d8e4-cc0e-48c6-b839-5aa704fc27ca tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:38.379202 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3e8d8e4-cc0e-48c6-b839-5aa704fc27ca tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:38.440462 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a3e8d8e4-cc0e-48c6-b839-5aa704fc27ca tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 38195 microversion: 2.1 time: 0.075534 Jan 18 20:28:38.441111 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 380/751] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:38 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 38195 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:28:38.907955 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b34126b3-b41b-405e-83d0-c7846a9799c4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:38.908566 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b34126b3-b41b-405e-83d0-c7846a9799c4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:38.914919 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b34126b3-b41b-405e-83d0-c7846a9799c4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:38.915403 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b34126b3-b41b-405e-83d0-c7846a9799c4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:38.916182 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b34126b3-b41b-405e-83d0-c7846a9799c4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:38.916618 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b34126b3-b41b-405e-83d0-c7846a9799c4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:39.049892 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b34126b3-b41b-405e-83d0-c7846a9799c4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:39.057624 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b34126b3-b41b-405e-83d0-c7846a9799c4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:39.059147 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b34126b3-b41b-405e-83d0-c7846a9799c4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:39.060990 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b34126b3-b41b-405e-83d0-c7846a9799c4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1722 microversion: 2.20 time: 0.156810 Jan 18 20:28:39.061556 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 372/752] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:38 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:28:39.452949 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c33d6291-6327-4331-8552-35da1bd12c22 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:39.453955 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c33d6291-6327-4331-8552-35da1bd12c22 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:39.461020 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c33d6291-6327-4331-8552-35da1bd12c22 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:39.461469 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c33d6291-6327-4331-8552-35da1bd12c22 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:39.462258 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c33d6291-6327-4331-8552-35da1bd12c22 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:39.462696 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c33d6291-6327-4331-8552-35da1bd12c22 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:39.534238 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c33d6291-6327-4331-8552-35da1bd12c22 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 38198 microversion: 2.1 time: 0.085102 Jan 18 20:28:39.534920 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 381/753] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:39 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 38198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:40.078866 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-cf56c47f-9236-4fb1-9ef2-5035a5871359 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:40.079507 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-cf56c47f-9236-4fb1-9ef2-5035a5871359 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:40.085796 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cf56c47f-9236-4fb1-9ef2-5035a5871359 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:40.086253 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cf56c47f-9236-4fb1-9ef2-5035a5871359 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:40.087055 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cf56c47f-9236-4fb1-9ef2-5035a5871359 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:40.087501 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cf56c47f-9236-4fb1-9ef2-5035a5871359 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:40.215017 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-cf56c47f-9236-4fb1-9ef2-5035a5871359 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:40.223589 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-cf56c47f-9236-4fb1-9ef2-5035a5871359 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:40.225226 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-cf56c47f-9236-4fb1-9ef2-5035a5871359 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:40.226577 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-cf56c47f-9236-4fb1-9ef2-5035a5871359 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1722 microversion: 2.20 time: 0.151301 Jan 18 20:28:40.227191 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 373/754] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:40 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:40.546658 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c7f96995-88b7-4b9c-a624-cff59c3876dc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:40.547948 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c7f96995-88b7-4b9c-a624-cff59c3876dc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:40.555124 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7f96995-88b7-4b9c-a624-cff59c3876dc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:40.555581 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7f96995-88b7-4b9c-a624-cff59c3876dc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:40.556360 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7f96995-88b7-4b9c-a624-cff59c3876dc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:40.556793 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7f96995-88b7-4b9c-a624-cff59c3876dc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:40.631410 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c7f96995-88b7-4b9c-a624-cff59c3876dc tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action" status: 200 len: 38324 microversion: 2.1 time: 0.088574 Jan 18 20:28:40.632071 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 382/755] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:28:40 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/action => generated 38324 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 18 20:28:40.642424 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-bb623454-cc24-4412-89e0-d8c4d8df30e5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:40.643234 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-bb623454-cc24-4412-89e0-d8c4d8df30e5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:40.649108 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bb623454-cc24-4412-89e0-d8c4d8df30e5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:40.649554 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bb623454-cc24-4412-89e0-d8c4d8df30e5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:40.650323 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bb623454-cc24-4412-89e0-d8c4d8df30e5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:40.650756 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bb623454-cc24-4412-89e0-d8c4d8df30e5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:40.673433 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-bb623454-cc24-4412-89e0-d8c4d8df30e5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/ips" status: 200 len: 146 microversion: 2.1 time: 0.035258 Jan 18 20:28:40.673996 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 374/756] 10.222.0.67 () {58 vars in 1247 bytes} [Tue Jan 18 20:28:40 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:28:41.246842 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ca8b26a5-76a5-46fb-beef-d8f80034c702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:41.248375 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ca8b26a5-76a5-46fb-beef-d8f80034c702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:41.257848 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca8b26a5-76a5-46fb-beef-d8f80034c702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:41.258308 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca8b26a5-76a5-46fb-beef-d8f80034c702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:41.259131 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca8b26a5-76a5-46fb-beef-d8f80034c702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:41.259575 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca8b26a5-76a5-46fb-beef-d8f80034c702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:41.406615 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ca8b26a5-76a5-46fb-beef-d8f80034c702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:41.414524 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ca8b26a5-76a5-46fb-beef-d8f80034c702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:41.415992 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ca8b26a5-76a5-46fb-beef-d8f80034c702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:41.417152 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ca8b26a5-76a5-46fb-beef-d8f80034c702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1722 microversion: 2.20 time: 0.174475 Jan 18 20:28:41.417707 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 383/757] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:41 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:41.975592 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b61819ed-e482-4221-9900-28bfef76bfaa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2163a5e-6739-4632-91d0-b6a8790f7129"}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:41.976660 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b61819ed-e482-4221-9900-28bfef76bfaa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:41.983418 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b61819ed-e482-4221-9900-28bfef76bfaa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:41.983876 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b61819ed-e482-4221-9900-28bfef76bfaa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:41.984724 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b61819ed-e482-4221-9900-28bfef76bfaa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:41.985113 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b61819ed-e482-4221-9900-28bfef76bfaa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:42.232044 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b61819ed-e482-4221-9900-28bfef76bfaa tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260079 Jan 18 20:28:42.233766 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 375/758] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Jan 18 20:28:41 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:28:42.435896 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f5e5ccfc-209a-4606-86f2-f1efa2e954b6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:42.436416 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f5e5ccfc-209a-4606-86f2-f1efa2e954b6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:42.442830 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f5e5ccfc-209a-4606-86f2-f1efa2e954b6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:42.443315 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f5e5ccfc-209a-4606-86f2-f1efa2e954b6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:42.444102 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f5e5ccfc-209a-4606-86f2-f1efa2e954b6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:42.444539 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f5e5ccfc-209a-4606-86f2-f1efa2e954b6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:42.578239 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f5e5ccfc-209a-4606-86f2-f1efa2e954b6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:42.587082 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f5e5ccfc-209a-4606-86f2-f1efa2e954b6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:42.588594 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f5e5ccfc-209a-4606-86f2-f1efa2e954b6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:42.589801 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f5e5ccfc-209a-4606-86f2-f1efa2e954b6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1722 microversion: 2.20 time: 0.157730 Jan 18 20:28:42.590374 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 384/759] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:42 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:43.610137 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0f2fe16f-0352-490b-8e4f-35de3ca3f7e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:43.610782 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0f2fe16f-0352-490b-8e4f-35de3ca3f7e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:43.617315 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0f2fe16f-0352-490b-8e4f-35de3ca3f7e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:43.617770 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0f2fe16f-0352-490b-8e4f-35de3ca3f7e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:43.618576 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0f2fe16f-0352-490b-8e4f-35de3ca3f7e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:43.619008 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0f2fe16f-0352-490b-8e4f-35de3ca3f7e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:43.761878 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-0f2fe16f-0352-490b-8e4f-35de3ca3f7e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:43.770352 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-0f2fe16f-0352-490b-8e4f-35de3ca3f7e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:43.771913 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-0f2fe16f-0352-490b-8e4f-35de3ca3f7e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:43.773111 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0f2fe16f-0352-490b-8e4f-35de3ca3f7e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1722 microversion: 2.20 time: 0.168432 Jan 18 20:28:43.773676 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 376/760] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:43 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:44.791348 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0f24b418-a4ab-4dff-a818-02b6407ad929 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:44.791962 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0f24b418-a4ab-4dff-a818-02b6407ad929 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:44.798551 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0f24b418-a4ab-4dff-a818-02b6407ad929 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:44.798997 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0f24b418-a4ab-4dff-a818-02b6407ad929 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:44.799795 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0f24b418-a4ab-4dff-a818-02b6407ad929 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:44.800226 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0f24b418-a4ab-4dff-a818-02b6407ad929 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:44.933354 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0f24b418-a4ab-4dff-a818-02b6407ad929 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:44.941209 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0f24b418-a4ab-4dff-a818-02b6407ad929 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:44.942712 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0f24b418-a4ab-4dff-a818-02b6407ad929 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:44.943907 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0f24b418-a4ab-4dff-a818-02b6407ad929 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1722 microversion: 2.20 time: 0.156263 Jan 18 20:28:44.944464 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 385/761] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:44 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:45.961541 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-49fefaf5-1d43-4e57-b320-8cd907df8e5c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:45.962138 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-49fefaf5-1d43-4e57-b320-8cd907df8e5c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:45.969001 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-49fefaf5-1d43-4e57-b320-8cd907df8e5c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:45.969445 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-49fefaf5-1d43-4e57-b320-8cd907df8e5c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:45.970216 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-49fefaf5-1d43-4e57-b320-8cd907df8e5c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:45.970652 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-49fefaf5-1d43-4e57-b320-8cd907df8e5c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:46.098945 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-49fefaf5-1d43-4e57-b320-8cd907df8e5c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:46.107226 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-49fefaf5-1d43-4e57-b320-8cd907df8e5c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:46.109251 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-49fefaf5-1d43-4e57-b320-8cd907df8e5c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:46.110433 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-49fefaf5-1d43-4e57-b320-8cd907df8e5c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1743 microversion: 2.20 time: 0.152664 Jan 18 20:28:46.111001 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 377/762] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:45 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:47.130547 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-eb72aaf6-2239-49f1-9bae-02304e8a2fee tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:47.131188 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-eb72aaf6-2239-49f1-9bae-02304e8a2fee tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:47.139294 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb72aaf6-2239-49f1-9bae-02304e8a2fee tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:47.139754 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb72aaf6-2239-49f1-9bae-02304e8a2fee tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:47.140557 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb72aaf6-2239-49f1-9bae-02304e8a2fee tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:47.140995 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb72aaf6-2239-49f1-9bae-02304e8a2fee tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:47.310304 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-eb72aaf6-2239-49f1-9bae-02304e8a2fee tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:47.319348 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-eb72aaf6-2239-49f1-9bae-02304e8a2fee tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:47.321932 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-eb72aaf6-2239-49f1-9bae-02304e8a2fee tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:47.323581 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-eb72aaf6-2239-49f1-9bae-02304e8a2fee tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1738 microversion: 2.20 time: 0.198031 Jan 18 20:28:47.324750 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 386/763] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:47 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:48.347393 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ff0fbc9e-9429-4ea9-9cf4-ce76ce44e6d4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:48.349694 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ff0fbc9e-9429-4ea9-9cf4-ce76ce44e6d4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:48.364766 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ff0fbc9e-9429-4ea9-9cf4-ce76ce44e6d4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:48.366030 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ff0fbc9e-9429-4ea9-9cf4-ce76ce44e6d4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:48.367463 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ff0fbc9e-9429-4ea9-9cf4-ce76ce44e6d4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:48.368599 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ff0fbc9e-9429-4ea9-9cf4-ce76ce44e6d4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:48.532757 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-ff0fbc9e-9429-4ea9-9cf4-ce76ce44e6d4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:48.543286 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-ff0fbc9e-9429-4ea9-9cf4-ce76ce44e6d4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:48.544914 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-ff0fbc9e-9429-4ea9-9cf4-ce76ce44e6d4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:48.551515 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ff0fbc9e-9429-4ea9-9cf4-ce76ce44e6d4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1738 microversion: 2.20 time: 0.206625 Jan 18 20:28:48.566163 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 378/764] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:48 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:49.264311 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-d9ebd216-20ed-4f35-b486-cd4cee7adb47 req-da2fe214-4e9b-45ac-8196-8452098a45f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d0afa1-510c-4954-8984-662702bb00dc", "name": "network-vif-plugged", "status": "completed", "tag": "40086b9f-1a65-40f2-9db4-6bf22c7ecd7d"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:49.266631 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:28:49.266631 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:28:49.275827 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-d9ebd216-20ed-4f35-b486-cd4cee7adb47 req-da2fe214-4e9b-45ac-8196-8452098a45f0 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:49.276543 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-d9ebd216-20ed-4f35-b486-cd4cee7adb47 req-da2fe214-4e9b-45ac-8196-8452098a45f0 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:49.289148 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-d9ebd216-20ed-4f35-b486-cd4cee7adb47 req-da2fe214-4e9b-45ac-8196-8452098a45f0 service nova] Creating event network-vif-plugged:40086b9f-1a65-40f2-9db4-6bf22c7ecd7d for instance c6d0afa1-510c-4954-8984-662702bb00dc on hv-cinder-82160 Jan 18 20:28:49.294462 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-d9ebd216-20ed-4f35-b486-cd4cee7adb47 req-da2fe214-4e9b-45ac-8196-8452098a45f0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129278 Jan 18 20:28:49.295891 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 387/765] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:28:49.573584 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0164895d-b739-4f35-a7fd-3c0d5ad761b3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:49.574234 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0164895d-b739-4f35-a7fd-3c0d5ad761b3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:49.581305 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0164895d-b739-4f35-a7fd-3c0d5ad761b3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:49.581760 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0164895d-b739-4f35-a7fd-3c0d5ad761b3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:49.582577 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0164895d-b739-4f35-a7fd-3c0d5ad761b3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:49.583007 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0164895d-b739-4f35-a7fd-3c0d5ad761b3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:49.771396 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5a841764-3a0f-40ee-b27c-4c18c3c17af7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:49.772699 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5a841764-3a0f-40ee-b27c-4c18c3c17af7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:49.780142 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a841764-3a0f-40ee-b27c-4c18c3c17af7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:49.780715 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a841764-3a0f-40ee-b27c-4c18c3c17af7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:49.781603 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a841764-3a0f-40ee-b27c-4c18c3c17af7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:49.782113 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a841764-3a0f-40ee-b27c-4c18c3c17af7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:49.784103 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-0164895d-b739-4f35-a7fd-3c0d5ad761b3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:49.799930 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-0164895d-b739-4f35-a7fd-3c0d5ad761b3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:49.804441 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-0164895d-b739-4f35-a7fd-3c0d5ad761b3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:49.806066 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0164895d-b739-4f35-a7fd-3c0d5ad761b3 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1738 microversion: 2.20 time: 0.236246 Jan 18 20:28:49.807111 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 379/766] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:49 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:49.827557 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5a841764-3a0f-40ee-b27c-4c18c3c17af7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060868 Jan 18 20:28:49.828412 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 388/767] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:28:49 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:28:49.840676 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-677c0d96-0ab4-4de0-8eee-1dcd043eb2dd tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:49.841312 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-677c0d96-0ab4-4de0-8eee-1dcd043eb2dd tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:49.849838 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-677c0d96-0ab4-4de0-8eee-1dcd043eb2dd tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:49.850345 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-677c0d96-0ab4-4de0-8eee-1dcd043eb2dd tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:49.851203 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-677c0d96-0ab4-4de0-8eee-1dcd043eb2dd tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:49.851909 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-677c0d96-0ab4-4de0-8eee-1dcd043eb2dd tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:49.888806 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-677c0d96-0ab4-4de0-8eee-1dcd043eb2dd tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments/f2163a5e-6739-4632-91d0-b6a8790f7129" status: 200 len: 194 microversion: 2.1 time: 0.052919 Jan 18 20:28:49.889522 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 380/768] 10.222.0.67 () {58 vars in 1412 bytes} [Tue Jan 18 20:28:49 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments/f2163a5e-6739-4632-91d0-b6a8790f7129 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:28:50.825142 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c7d1cf2b-8c8b-4a99-821e-c93b9a53cd5a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:50.825780 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c7d1cf2b-8c8b-4a99-821e-c93b9a53cd5a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:50.834717 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7d1cf2b-8c8b-4a99-821e-c93b9a53cd5a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:50.835491 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7d1cf2b-8c8b-4a99-821e-c93b9a53cd5a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:50.836473 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7d1cf2b-8c8b-4a99-821e-c93b9a53cd5a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:50.836896 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7d1cf2b-8c8b-4a99-821e-c93b9a53cd5a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:51.008358 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c7d1cf2b-8c8b-4a99-821e-c93b9a53cd5a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:51.023701 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c7d1cf2b-8c8b-4a99-821e-c93b9a53cd5a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:51.025556 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c7d1cf2b-8c8b-4a99-821e-c93b9a53cd5a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:51.026744 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c7d1cf2b-8c8b-4a99-821e-c93b9a53cd5a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1738 microversion: 2.20 time: 0.205476 Jan 18 20:28:51.027898 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 389/769] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:50 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:51.290777 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-3f49f35e-ef24-4af7-9b0b-633ff3e92d08 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2712b2e-790f-4612-9d5b-ce9976ce8455"}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:51.297490 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-3f49f35e-ef24-4af7-9b0b-633ff3e92d08 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:51.307348 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3f49f35e-ef24-4af7-9b0b-633ff3e92d08 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:51.308183 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3f49f35e-ef24-4af7-9b0b-633ff3e92d08 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:51.309117 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3f49f35e-ef24-4af7-9b0b-633ff3e92d08 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:51.309915 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3f49f35e-ef24-4af7-9b0b-633ff3e92d08 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:51.699782 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-3f49f35e-ef24-4af7-9b0b-633ff3e92d08 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412034 Jan 18 20:28:51.701672 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 381/770] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Jan 18 20:28:51 2022] POST /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:28:52.050352 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c3e2726d-66db-4c01-97ee-e90f89f05a54 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:52.051579 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c3e2726d-66db-4c01-97ee-e90f89f05a54 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:52.063251 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3e2726d-66db-4c01-97ee-e90f89f05a54 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:52.064649 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3e2726d-66db-4c01-97ee-e90f89f05a54 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:52.066294 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3e2726d-66db-4c01-97ee-e90f89f05a54 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:52.067386 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3e2726d-66db-4c01-97ee-e90f89f05a54 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:52.240547 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c3e2726d-66db-4c01-97ee-e90f89f05a54 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:52.257100 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c3e2726d-66db-4c01-97ee-e90f89f05a54 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:52.258814 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c3e2726d-66db-4c01-97ee-e90f89f05a54 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:52.260275 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c3e2726d-66db-4c01-97ee-e90f89f05a54 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1738 microversion: 2.20 time: 0.217350 Jan 18 20:28:52.268345 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 390/771] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:52 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:28:53.282586 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-efecb6e3-b00b-4493-b5a5-5490639c5ee4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:53.283971 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-efecb6e3-b00b-4493-b5a5-5490639c5ee4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:53.295541 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-efecb6e3-b00b-4493-b5a5-5490639c5ee4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:53.295541 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-efecb6e3-b00b-4493-b5a5-5490639c5ee4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:53.295541 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-efecb6e3-b00b-4493-b5a5-5490639c5ee4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:53.295541 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-efecb6e3-b00b-4493-b5a5-5490639c5ee4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:53.459872 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-efecb6e3-b00b-4493-b5a5-5490639c5ee4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:53.468677 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-efecb6e3-b00b-4493-b5a5-5490639c5ee4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:53.470468 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-efecb6e3-b00b-4493-b5a5-5490639c5ee4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:53.471832 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-efecb6e3-b00b-4493-b5a5-5490639c5ee4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1738 microversion: 2.20 time: 0.195806 Jan 18 20:28:53.472802 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 382/772] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:53 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:54.492950 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a3ccebba-c9ba-48e8-9910-3605087dd816 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:54.496438 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a3ccebba-c9ba-48e8-9910-3605087dd816 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:54.507196 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3ccebba-c9ba-48e8-9910-3605087dd816 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:54.507922 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3ccebba-c9ba-48e8-9910-3605087dd816 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:54.508850 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3ccebba-c9ba-48e8-9910-3605087dd816 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:54.509486 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3ccebba-c9ba-48e8-9910-3605087dd816 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:54.670952 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a3ccebba-c9ba-48e8-9910-3605087dd816 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:54.681614 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a3ccebba-c9ba-48e8-9910-3605087dd816 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:54.683552 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a3ccebba-c9ba-48e8-9910-3605087dd816 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:54.685313 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a3ccebba-c9ba-48e8-9910-3605087dd816 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1738 microversion: 2.20 time: 0.199016 Jan 18 20:28:54.685910 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 391/773] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:54 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:55.706007 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-89e9bc53-fd58-4bae-81ee-f6168f3cc13b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:55.707292 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-89e9bc53-fd58-4bae-81ee-f6168f3cc13b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:55.714122 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-89e9bc53-fd58-4bae-81ee-f6168f3cc13b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:55.714686 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-89e9bc53-fd58-4bae-81ee-f6168f3cc13b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:55.715580 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-89e9bc53-fd58-4bae-81ee-f6168f3cc13b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:55.716765 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-89e9bc53-fd58-4bae-81ee-f6168f3cc13b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:55.881797 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-89e9bc53-fd58-4bae-81ee-f6168f3cc13b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:55.892686 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-89e9bc53-fd58-4bae-81ee-f6168f3cc13b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:55.894190 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-89e9bc53-fd58-4bae-81ee-f6168f3cc13b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:55.895569 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-89e9bc53-fd58-4bae-81ee-f6168f3cc13b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1738 microversion: 2.20 time: 0.195117 Jan 18 20:28:55.907469 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 383/774] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:55 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:28:56.916821 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8c974618-f49b-4610-9ed5-fec556cdbd72 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:56.917425 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8c974618-f49b-4610-9ed5-fec556cdbd72 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:56.925470 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c974618-f49b-4610-9ed5-fec556cdbd72 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:56.925704 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c974618-f49b-4610-9ed5-fec556cdbd72 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:56.926378 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c974618-f49b-4610-9ed5-fec556cdbd72 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:56.927084 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c974618-f49b-4610-9ed5-fec556cdbd72 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:57.069634 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8c974618-f49b-4610-9ed5-fec556cdbd72 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:57.079336 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8c974618-f49b-4610-9ed5-fec556cdbd72 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:57.080855 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8c974618-f49b-4610-9ed5-fec556cdbd72 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:57.082200 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8c974618-f49b-4610-9ed5-fec556cdbd72 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1720 microversion: 2.20 time: 0.169150 Jan 18 20:28:57.088532 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 392/775] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:56 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:58.101471 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-3e70e8b4-4aaf-45c5-98f9-81e678579eef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:58.102463 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-3e70e8b4-4aaf-45c5-98f9-81e678579eef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:58.113519 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3e70e8b4-4aaf-45c5-98f9-81e678579eef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:58.113975 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3e70e8b4-4aaf-45c5-98f9-81e678579eef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:58.114772 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3e70e8b4-4aaf-45c5-98f9-81e678579eef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:58.115235 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3e70e8b4-4aaf-45c5-98f9-81e678579eef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:58.284197 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-3e70e8b4-4aaf-45c5-98f9-81e678579eef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:58.292717 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-3e70e8b4-4aaf-45c5-98f9-81e678579eef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:58.294758 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-3e70e8b4-4aaf-45c5-98f9-81e678579eef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:58.295991 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-3e70e8b4-4aaf-45c5-98f9-81e678579eef tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1720 microversion: 2.20 time: 0.198435 Jan 18 20:28:58.296558 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 384/776] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:58 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1720 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:59.249434 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8a0aee3f-e944-494d-8610-d8cc64d2a58c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:59.250346 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8a0aee3f-e944-494d-8610-d8cc64d2a58c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:59.257472 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8a0aee3f-e944-494d-8610-d8cc64d2a58c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:59.258160 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8a0aee3f-e944-494d-8610-d8cc64d2a58c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:59.259015 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8a0aee3f-e944-494d-8610-d8cc64d2a58c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:59.259525 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8a0aee3f-e944-494d-8610-d8cc64d2a58c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:59.290444 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8a0aee3f-e944-494d-8610-d8cc64d2a58c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044667 Jan 18 20:28:59.291010 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 393/777] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:28:59 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:28:59.315284 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-955dbde2-450f-4d18-a7a9-60624bc3ecd2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:59.315896 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-955dbde2-450f-4d18-a7a9-60624bc3ecd2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:59.322994 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-955dbde2-450f-4d18-a7a9-60624bc3ecd2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:59.323635 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-955dbde2-450f-4d18-a7a9-60624bc3ecd2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:59.324467 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-955dbde2-450f-4d18-a7a9-60624bc3ecd2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:59.324921 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-955dbde2-450f-4d18-a7a9-60624bc3ecd2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:59.468085 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-955dbde2-450f-4d18-a7a9-60624bc3ecd2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:59.476241 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-955dbde2-450f-4d18-a7a9-60624bc3ecd2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:59.477736 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-955dbde2-450f-4d18-a7a9-60624bc3ecd2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:28:59.478896 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-955dbde2-450f-4d18-a7a9-60624bc3ecd2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1723 microversion: 2.20 time: 0.167596 Jan 18 20:28:59.479490 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 385/778] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:28:59 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:28:59.500499 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2cf8e376-a12f-443a-beb9-8a683ebba70c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e8fc772-beaa-4de1-87fe-ae6dfabd909f"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:28:59.501998 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2cf8e376-a12f-443a-beb9-8a683ebba70c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:59.510602 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2cf8e376-a12f-443a-beb9-8a683ebba70c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:59.511074 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2cf8e376-a12f-443a-beb9-8a683ebba70c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:59.512017 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2cf8e376-a12f-443a-beb9-8a683ebba70c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:59.512453 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2cf8e376-a12f-443a-beb9-8a683ebba70c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:59.533518 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b69b6052-b8fe-4349-a063-156f99d4b8c2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:59.534053 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b69b6052-b8fe-4349-a063-156f99d4b8c2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:59.547939 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b69b6052-b8fe-4349-a063-156f99d4b8c2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:59.548391 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b69b6052-b8fe-4349-a063-156f99d4b8c2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:59.549218 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b69b6052-b8fe-4349-a063-156f99d4b8c2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:59.549662 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b69b6052-b8fe-4349-a063-156f99d4b8c2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:59.582865 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b69b6052-b8fe-4349-a063-156f99d4b8c2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments/f2163a5e-6739-4632-91d0-b6a8790f7129" status: 200 len: 194 microversion: 2.1 time: 0.053081 Jan 18 20:28:59.583813 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 386/779] 10.222.0.67 () {58 vars in 1412 bytes} [Tue Jan 18 20:28:59 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments/f2163a5e-6739-4632-91d0-b6a8790f7129 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:28:59.597692 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-1ae7e22a-af67-42a5-b8f1-fdb992d99329 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:59.598236 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-1ae7e22a-af67-42a5-b8f1-fdb992d99329 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:59.604441 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1ae7e22a-af67-42a5-b8f1-fdb992d99329 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:59.604896 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1ae7e22a-af67-42a5-b8f1-fdb992d99329 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:59.605697 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1ae7e22a-af67-42a5-b8f1-fdb992d99329 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:59.606136 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1ae7e22a-af67-42a5-b8f1-fdb992d99329 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:59.691439 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.objects.instance [None req-1ae7e22a-af67-42a5-b8f1-fdb992d99329 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lazy-loading 'services' on Instance uuid ca1b7d23-2dbd-4028-8c9e-6760c49670aa {{(pid=116376) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:28:59.767560 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-1ae7e22a-af67-42a5-b8f1-fdb992d99329 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments/f2163a5e-6739-4632-91d0-b6a8790f7129" status: 202 len: 0 microversion: 2.1 time: 0.174732 Jan 18 20:28:59.772086 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 387/780] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Jan 18 20:28:59 2022] DELETE /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments/f2163a5e-6739-4632-91d0-b6a8790f7129 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:28:59.851766 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2cf8e376-a12f-443a-beb9-8a683ebba70c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.354659 Jan 18 20:28:59.852416 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 394/781] 10.222.0.67 () {62 vars in 1363 bytes} [Tue Jan 18 20:28:59 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/os-volume_attachments => generated 188 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 18 20:28:59.963212 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-3d5fa816-8195-4692-a95b-f0368ad7a9a7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:28:59.963790 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-3d5fa816-8195-4692-a95b-f0368ad7a9a7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:28:59.970097 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3d5fa816-8195-4692-a95b-f0368ad7a9a7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:59.970514 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3d5fa816-8195-4692-a95b-f0368ad7a9a7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:28:59.971338 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3d5fa816-8195-4692-a95b-f0368ad7a9a7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:28:59.971777 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3d5fa816-8195-4692-a95b-f0368ad7a9a7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:00.203573 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-3d5fa816-8195-4692-a95b-f0368ad7a9a7 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/os-volume_attachments/6e8fc772-beaa-4de1-87fe-ae6dfabd909f" status: 202 len: 0 microversion: 2.20 time: 0.244368 Jan 18 20:29:00.204179 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 388/782] 10.222.0.67 () {60 vars in 1456 bytes} [Tue Jan 18 20:28:59 2022] DELETE /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/os-volume_attachments/6e8fc772-beaa-4de1-87fe-ae6dfabd909f => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:29:00.259616 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1ca113b3-8b39-4fe8-be41-7639521861e2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:29:00.260326 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1ca113b3-8b39-4fe8-be41-7639521861e2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:00.266661 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ca113b3-8b39-4fe8-be41-7639521861e2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:00.267144 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ca113b3-8b39-4fe8-be41-7639521861e2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:00.267918 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ca113b3-8b39-4fe8-be41-7639521861e2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:00.268343 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ca113b3-8b39-4fe8-be41-7639521861e2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:00.401250 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1ca113b3-8b39-4fe8-be41-7639521861e2 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action" status: 202 len: 0 microversion: 2.20 time: 0.145787 Jan 18 20:29:00.401853 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 395/783] 10.222.0.67 () {62 vars in 1318 bytes} [Tue Jan 18 20:29:00 2022] POST /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 18 20:29:00.410084 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fbbf68a5-c55d-4d8e-8829-605a73b46f24 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:00.410696 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-fbbf68a5-c55d-4d8e-8829-605a73b46f24 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:00.417580 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fbbf68a5-c55d-4d8e-8829-605a73b46f24 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:00.418028 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fbbf68a5-c55d-4d8e-8829-605a73b46f24 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:00.418812 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fbbf68a5-c55d-4d8e-8829-605a73b46f24 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:00.419836 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fbbf68a5-c55d-4d8e-8829-605a73b46f24 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:00.592418 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-fbbf68a5-c55d-4d8e-8829-605a73b46f24 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:00.600637 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-fbbf68a5-c55d-4d8e-8829-605a73b46f24 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:00.602130 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-fbbf68a5-c55d-4d8e-8829-605a73b46f24 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:00.603320 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-fbbf68a5-c55d-4d8e-8829-605a73b46f24 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1671 microversion: 2.20 time: 0.196847 Jan 18 20:29:00.603879 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 389/784] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:00 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1671 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:29:00.909848 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c534b15f-75a7-4c0f-91ba-91c17730da5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:00.910386 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c534b15f-75a7-4c0f-91ba-91c17730da5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:00.917126 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c534b15f-75a7-4c0f-91ba-91c17730da5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:00.917774 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c534b15f-75a7-4c0f-91ba-91c17730da5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:00.918439 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c534b15f-75a7-4c0f-91ba-91c17730da5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:00.919090 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c534b15f-75a7-4c0f-91ba-91c17730da5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:00.955121 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c534b15f-75a7-4c0f-91ba-91c17730da5c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments/b2712b2e-790f-4612-9d5b-ce9976ce8455" status: 200 len: 194 microversion: 2.1 time: 0.058938 Jan 18 20:29:00.955782 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 396/785] 10.222.0.67 () {58 vars in 1412 bytes} [Tue Jan 18 20:29:00 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments/b2712b2e-790f-4612-9d5b-ce9976ce8455 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:29:00.966499 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e2cfd669-9617-45c3-a557-8db89e00c2ec tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:00.967096 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e2cfd669-9617-45c3-a557-8db89e00c2ec tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:00.974132 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e2cfd669-9617-45c3-a557-8db89e00c2ec tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:00.974850 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e2cfd669-9617-45c3-a557-8db89e00c2ec tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:00.975923 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e2cfd669-9617-45c3-a557-8db89e00c2ec tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:00.976434 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e2cfd669-9617-45c3-a557-8db89e00c2ec tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:01.069046 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.objects.instance [None req-e2cfd669-9617-45c3-a557-8db89e00c2ec tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lazy-loading 'services' on Instance uuid ca1b7d23-2dbd-4028-8c9e-6760c49670aa {{(pid=116376) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:29:01.148126 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e2cfd669-9617-45c3-a557-8db89e00c2ec tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments/b2712b2e-790f-4612-9d5b-ce9976ce8455" status: 202 len: 0 microversion: 2.1 time: 0.186182 Jan 18 20:29:01.149018 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 390/786] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Jan 18 20:29:00 2022] DELETE /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments/b2712b2e-790f-4612-9d5b-ce9976ce8455 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:29:01.173504 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-b4a5fe9f-c7dd-4ea3-8b79-7f3294cba9ad req-3f82d038-313e-457a-99d3-e4c5a3425ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d0afa1-510c-4954-8984-662702bb00dc", "name": "network-vif-unplugged", "status": "completed", "tag": "40086b9f-1a65-40f2-9db4-6bf22c7ecd7d"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:29:01.175496 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:29:01.175496 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:29:01.192936 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-b4a5fe9f-c7dd-4ea3-8b79-7f3294cba9ad req-3f82d038-313e-457a-99d3-e4c5a3425ff6 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:01.193666 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-b4a5fe9f-c7dd-4ea3-8b79-7f3294cba9ad req-3f82d038-313e-457a-99d3-e4c5a3425ff6 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:01.216813 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.compute.server_external_events [req-b4a5fe9f-c7dd-4ea3-8b79-7f3294cba9ad req-3f82d038-313e-457a-99d3-e4c5a3425ff6 service nova] Unable to find a host for instance c6d0afa1-510c-4954-8984-662702bb00dc. Dropping event network-vif-unplugged {{(pid=116375) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 18 20:29:01.217707 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-b4a5fe9f-c7dd-4ea3-8b79-7f3294cba9ad req-3f82d038-313e-457a-99d3-e4c5a3425ff6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.048704 Jan 18 20:29:01.218309 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 397/787] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 18 20:29:01.622357 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a8e3adf8-7d7e-422e-bd42-ec606629c9d1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:01.623115 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-a8e3adf8-7d7e-422e-bd42-ec606629c9d1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:01.629982 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a8e3adf8-7d7e-422e-bd42-ec606629c9d1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:01.630434 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a8e3adf8-7d7e-422e-bd42-ec606629c9d1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:01.631262 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a8e3adf8-7d7e-422e-bd42-ec606629c9d1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:01.631699 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a8e3adf8-7d7e-422e-bd42-ec606629c9d1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:01.909513 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a8e3adf8-7d7e-422e-bd42-ec606629c9d1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:01.918671 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a8e3adf8-7d7e-422e-bd42-ec606629c9d1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:01.921332 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a8e3adf8-7d7e-422e-bd42-ec606629c9d1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:01.922683 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a8e3adf8-7d7e-422e-bd42-ec606629c9d1 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1729 microversion: 2.20 time: 0.304683 Jan 18 20:29:01.927248 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 391/788] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:01 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1729 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:29:02.337256 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-87f20c3b-6538-42e9-acc1-06dde952c683 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:02.338200 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-87f20c3b-6538-42e9-acc1-06dde952c683 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:02.345872 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-87f20c3b-6538-42e9-acc1-06dde952c683 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:02.346331 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-87f20c3b-6538-42e9-acc1-06dde952c683 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:02.347171 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-87f20c3b-6538-42e9-acc1-06dde952c683 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:02.347609 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-87f20c3b-6538-42e9-acc1-06dde952c683 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:02.379164 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-87f20c3b-6538-42e9-acc1-06dde952c683 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045529 Jan 18 20:29:02.380030 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 398/789] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:29:02 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:29:02.496702 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-52fa37d0-761e-4280-bca6-912d7d51773b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:02.498240 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-52fa37d0-761e-4280-bca6-912d7d51773b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:02.504533 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-52fa37d0-761e-4280-bca6-912d7d51773b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:02.504981 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-52fa37d0-761e-4280-bca6-912d7d51773b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:02.505791 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-52fa37d0-761e-4280-bca6-912d7d51773b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:02.506234 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-52fa37d0-761e-4280-bca6-912d7d51773b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:02.542281 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-52fa37d0-761e-4280-bca6-912d7d51773b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049842 Jan 18 20:29:02.542864 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 392/790] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:29:02 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 18 20:29:02.612329 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-004ab607-50d8-44c3-b39a-03d51f0f0eb7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:02.612997 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-004ab607-50d8-44c3-b39a-03d51f0f0eb7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:02.620063 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-004ab607-50d8-44c3-b39a-03d51f0f0eb7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:02.620524 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-004ab607-50d8-44c3-b39a-03d51f0f0eb7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:02.621348 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-004ab607-50d8-44c3-b39a-03d51f0f0eb7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:02.621822 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-004ab607-50d8-44c3-b39a-03d51f0f0eb7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:02.648728 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-004ab607-50d8-44c3-b39a-03d51f0f0eb7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:29:02.735463 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-004ab607-50d8-44c3-b39a-03d51f0f0eb7 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 204 len: 0 microversion: 2.1 time: 0.127373 Jan 18 20:29:02.736299 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 399/791] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:29:02 2022] DELETE /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 18 20:29:02.744429 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-3aefd2bc-9ea4-44e0-aadc-76f8911beb8d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:02.745303 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-3aefd2bc-9ea4-44e0-aadc-76f8911beb8d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:02.752699 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3aefd2bc-9ea4-44e0-aadc-76f8911beb8d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:02.753154 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3aefd2bc-9ea4-44e0-aadc-76f8911beb8d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:02.754194 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3aefd2bc-9ea4-44e0-aadc-76f8911beb8d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:02.754560 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3aefd2bc-9ea4-44e0-aadc-76f8911beb8d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:02.917948 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-3aefd2bc-9ea4-44e0-aadc-76f8911beb8d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:02.933391 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-3aefd2bc-9ea4-44e0-aadc-76f8911beb8d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1674 microversion: 2.1 time: 0.192661 Jan 18 20:29:02.935474 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 393/792] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:02 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1674 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:29:02.949600 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-19598178-864d-4001-8fec-cffb71cb2702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:02.950921 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-19598178-864d-4001-8fec-cffb71cb2702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:02.959587 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-19598178-864d-4001-8fec-cffb71cb2702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:02.960330 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-19598178-864d-4001-8fec-cffb71cb2702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:02.961447 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-19598178-864d-4001-8fec-cffb71cb2702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:02.962246 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-19598178-864d-4001-8fec-cffb71cb2702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:03.183426 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-19598178-864d-4001-8fec-cffb71cb2702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:03.193194 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-19598178-864d-4001-8fec-cffb71cb2702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:03.195164 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-19598178-864d-4001-8fec-cffb71cb2702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:03.196640 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-19598178-864d-4001-8fec-cffb71cb2702 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1729 microversion: 2.20 time: 0.253920 Jan 18 20:29:03.197551 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 400/793] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:02 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1729 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:29:03.951634 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-1a1eb228-787b-4ff0-992b-8a4f88a20267 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:03.952419 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-1a1eb228-787b-4ff0-992b-8a4f88a20267 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:03.962950 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1a1eb228-787b-4ff0-992b-8a4f88a20267 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:03.963632 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1a1eb228-787b-4ff0-992b-8a4f88a20267 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:03.964494 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1a1eb228-787b-4ff0-992b-8a4f88a20267 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:03.965147 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1a1eb228-787b-4ff0-992b-8a4f88a20267 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:04.111368 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-1a1eb228-787b-4ff0-992b-8a4f88a20267 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:04.119176 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-1a1eb228-787b-4ff0-992b-8a4f88a20267 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1674 microversion: 2.1 time: 0.171804 Jan 18 20:29:04.119846 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 394/794] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:03 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:29:04.215354 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-18b8d4a3-e71e-4d32-a38f-44dc5d7d9feb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:04.216001 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-18b8d4a3-e71e-4d32-a38f-44dc5d7d9feb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:04.222324 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-18b8d4a3-e71e-4d32-a38f-44dc5d7d9feb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:04.222770 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-18b8d4a3-e71e-4d32-a38f-44dc5d7d9feb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:04.223578 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-18b8d4a3-e71e-4d32-a38f-44dc5d7d9feb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:04.224011 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-18b8d4a3-e71e-4d32-a38f-44dc5d7d9feb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:04.371108 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-18b8d4a3-e71e-4d32-a38f-44dc5d7d9feb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:04.382039 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-18b8d4a3-e71e-4d32-a38f-44dc5d7d9feb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:04.383616 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-18b8d4a3-e71e-4d32-a38f-44dc5d7d9feb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:04.385328 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-18b8d4a3-e71e-4d32-a38f-44dc5d7d9feb tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1729 microversion: 2.20 time: 0.173682 Jan 18 20:29:04.385991 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 401/795] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:04 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:29:05.137579 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-881a55a9-b2b7-4e0c-b22f-3521e0de17a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:05.138931 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-881a55a9-b2b7-4e0c-b22f-3521e0de17a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:05.145728 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-881a55a9-b2b7-4e0c-b22f-3521e0de17a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:05.146247 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-881a55a9-b2b7-4e0c-b22f-3521e0de17a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:05.147003 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-881a55a9-b2b7-4e0c-b22f-3521e0de17a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:05.147480 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-881a55a9-b2b7-4e0c-b22f-3521e0de17a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:05.315049 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-881a55a9-b2b7-4e0c-b22f-3521e0de17a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:05.326934 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-881a55a9-b2b7-4e0c-b22f-3521e0de17a2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1674 microversion: 2.1 time: 0.194304 Jan 18 20:29:05.327813 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 395/796] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:05 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1674 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:29:05.404870 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b7170ab5-da48-4f89-af11-b03d2f0db50b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:05.405842 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b7170ab5-da48-4f89-af11-b03d2f0db50b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:05.419976 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b7170ab5-da48-4f89-af11-b03d2f0db50b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:05.421860 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b7170ab5-da48-4f89-af11-b03d2f0db50b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:05.424656 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b7170ab5-da48-4f89-af11-b03d2f0db50b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:05.424656 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b7170ab5-da48-4f89-af11-b03d2f0db50b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:05.588674 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b7170ab5-da48-4f89-af11-b03d2f0db50b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:05.598792 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b7170ab5-da48-4f89-af11-b03d2f0db50b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:05.600366 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b7170ab5-da48-4f89-af11-b03d2f0db50b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:05.601581 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b7170ab5-da48-4f89-af11-b03d2f0db50b tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1729 microversion: 2.20 time: 0.201251 Jan 18 20:29:05.602375 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 402/797] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:05 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:29:06.355329 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-906a0283-6172-4c26-a321-6977fdbd8c70 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:06.355938 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-906a0283-6172-4c26-a321-6977fdbd8c70 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:06.362954 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-906a0283-6172-4c26-a321-6977fdbd8c70 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:06.363804 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-906a0283-6172-4c26-a321-6977fdbd8c70 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:06.364867 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-906a0283-6172-4c26-a321-6977fdbd8c70 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:06.365532 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-906a0283-6172-4c26-a321-6977fdbd8c70 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:06.539927 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-906a0283-6172-4c26-a321-6977fdbd8c70 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:06.552716 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-906a0283-6172-4c26-a321-6977fdbd8c70 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1674 microversion: 2.1 time: 0.205133 Jan 18 20:29:06.553303 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 396/798] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:06 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1674 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:29:06.630423 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ffdf58eb-57cf-4699-8503-b3930c4912a9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:06.630967 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ffdf58eb-57cf-4699-8503-b3930c4912a9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:06.637574 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ffdf58eb-57cf-4699-8503-b3930c4912a9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:06.638025 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ffdf58eb-57cf-4699-8503-b3930c4912a9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:06.638806 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ffdf58eb-57cf-4699-8503-b3930c4912a9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:06.639276 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ffdf58eb-57cf-4699-8503-b3930c4912a9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:06.803594 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ffdf58eb-57cf-4699-8503-b3930c4912a9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:06.823400 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ffdf58eb-57cf-4699-8503-b3930c4912a9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:06.825183 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ffdf58eb-57cf-4699-8503-b3930c4912a9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:06.826414 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ffdf58eb-57cf-4699-8503-b3930c4912a9 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1729 microversion: 2.20 time: 0.200445 Jan 18 20:29:06.826970 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 403/799] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:06 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:29:07.574400 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-cbcb916e-7b27-4eb3-8f65-e28646ce1a6c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:07.578056 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-cbcb916e-7b27-4eb3-8f65-e28646ce1a6c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:07.584744 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cbcb916e-7b27-4eb3-8f65-e28646ce1a6c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:07.585201 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cbcb916e-7b27-4eb3-8f65-e28646ce1a6c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:07.585995 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cbcb916e-7b27-4eb3-8f65-e28646ce1a6c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:07.586430 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cbcb916e-7b27-4eb3-8f65-e28646ce1a6c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:07.740255 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-cbcb916e-7b27-4eb3-8f65-e28646ce1a6c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:07.748881 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-cbcb916e-7b27-4eb3-8f65-e28646ce1a6c tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1674 microversion: 2.1 time: 0.180321 Jan 18 20:29:07.749738 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 397/800] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:07 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:29:07.853693 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ff96d2e1-ff03-4563-963b-558eed60ee09 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:07.856573 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ff96d2e1-ff03-4563-963b-558eed60ee09 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:07.864808 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ff96d2e1-ff03-4563-963b-558eed60ee09 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:07.865270 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ff96d2e1-ff03-4563-963b-558eed60ee09 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:07.866357 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ff96d2e1-ff03-4563-963b-558eed60ee09 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:07.866894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ff96d2e1-ff03-4563-963b-558eed60ee09 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:08.054787 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ff96d2e1-ff03-4563-963b-558eed60ee09 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:08.064103 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ff96d2e1-ff03-4563-963b-558eed60ee09 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:08.065666 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ff96d2e1-ff03-4563-963b-558eed60ee09 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:08.066923 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ff96d2e1-ff03-4563-963b-558eed60ee09 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1729 microversion: 2.20 time: 0.222060 Jan 18 20:29:08.067639 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 404/801] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:07 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:29:08.767913 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-478cc7af-27f2-4d10-bdd1-653d62363e97 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:08.768551 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-478cc7af-27f2-4d10-bdd1-653d62363e97 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:08.775123 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-478cc7af-27f2-4d10-bdd1-653d62363e97 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:08.787583 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-478cc7af-27f2-4d10-bdd1-653d62363e97 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:08.788521 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-478cc7af-27f2-4d10-bdd1-653d62363e97 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:08.788976 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-478cc7af-27f2-4d10-bdd1-653d62363e97 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:08.978976 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-478cc7af-27f2-4d10-bdd1-653d62363e97 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:08.987488 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-478cc7af-27f2-4d10-bdd1-653d62363e97 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1674 microversion: 2.1 time: 0.223283 Jan 18 20:29:08.988077 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 398/802] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:08 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1674 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:29:09.086080 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7c964056-ebc2-4eb9-a845-cbe498a4e89d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:09.087003 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7c964056-ebc2-4eb9-a845-cbe498a4e89d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:09.094451 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7c964056-ebc2-4eb9-a845-cbe498a4e89d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:09.094908 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7c964056-ebc2-4eb9-a845-cbe498a4e89d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:09.095737 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7c964056-ebc2-4eb9-a845-cbe498a4e89d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:09.096169 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7c964056-ebc2-4eb9-a845-cbe498a4e89d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:09.253411 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7c964056-ebc2-4eb9-a845-cbe498a4e89d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:09.262135 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7c964056-ebc2-4eb9-a845-cbe498a4e89d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:09.263659 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7c964056-ebc2-4eb9-a845-cbe498a4e89d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:09.264919 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7c964056-ebc2-4eb9-a845-cbe498a4e89d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1729 microversion: 2.20 time: 0.182653 Jan 18 20:29:09.265493 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 405/803] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:09 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:29:10.007786 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0eba34bb-8d4e-41ef-89b6-e9d096713a29 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:10.008752 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0eba34bb-8d4e-41ef-89b6-e9d096713a29 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:10.015688 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0eba34bb-8d4e-41ef-89b6-e9d096713a29 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:10.016133 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0eba34bb-8d4e-41ef-89b6-e9d096713a29 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:10.017160 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0eba34bb-8d4e-41ef-89b6-e9d096713a29 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:10.017354 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0eba34bb-8d4e-41ef-89b6-e9d096713a29 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:10.159798 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-0eba34bb-8d4e-41ef-89b6-e9d096713a29 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:10.168027 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0eba34bb-8d4e-41ef-89b6-e9d096713a29 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1674 microversion: 2.1 time: 0.163697 Jan 18 20:29:10.178484 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 399/804] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:10 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:29:10.282918 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-73e80b29-7445-45b0-a548-1dbd1c003620 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:10.283720 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-73e80b29-7445-45b0-a548-1dbd1c003620 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:10.291215 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-73e80b29-7445-45b0-a548-1dbd1c003620 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:10.291736 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-73e80b29-7445-45b0-a548-1dbd1c003620 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:10.292972 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-73e80b29-7445-45b0-a548-1dbd1c003620 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:10.294207 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-73e80b29-7445-45b0-a548-1dbd1c003620 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:10.456018 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-73e80b29-7445-45b0-a548-1dbd1c003620 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:10.464162 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-73e80b29-7445-45b0-a548-1dbd1c003620 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:10.465984 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-73e80b29-7445-45b0-a548-1dbd1c003620 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:10.467159 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-73e80b29-7445-45b0-a548-1dbd1c003620 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1729 microversion: 2.20 time: 0.188144 Jan 18 20:29:10.467729 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 406/805] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:10 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:29:11.186844 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-8afe317e-4985-4731-82a1-ccd90778e2f2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:11.187446 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-8afe317e-4985-4731-82a1-ccd90778e2f2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:11.193972 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8afe317e-4985-4731-82a1-ccd90778e2f2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:11.194428 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8afe317e-4985-4731-82a1-ccd90778e2f2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:11.195240 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8afe317e-4985-4731-82a1-ccd90778e2f2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:11.195688 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8afe317e-4985-4731-82a1-ccd90778e2f2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:11.329276 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-8afe317e-4985-4731-82a1-ccd90778e2f2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:11.336624 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-8afe317e-4985-4731-82a1-ccd90778e2f2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1674 microversion: 2.1 time: 0.154268 Jan 18 20:29:11.337192 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 400/806] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:11 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:29:11.491743 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9eb65a84-ec55-4c8f-b97d-5196332184ae tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:11.492526 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9eb65a84-ec55-4c8f-b97d-5196332184ae tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:11.498741 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9eb65a84-ec55-4c8f-b97d-5196332184ae tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:11.499252 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9eb65a84-ec55-4c8f-b97d-5196332184ae tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:11.500034 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9eb65a84-ec55-4c8f-b97d-5196332184ae tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:11.500460 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9eb65a84-ec55-4c8f-b97d-5196332184ae tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:11.635239 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9eb65a84-ec55-4c8f-b97d-5196332184ae tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:11.643068 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9eb65a84-ec55-4c8f-b97d-5196332184ae tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:11.644539 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9eb65a84-ec55-4c8f-b97d-5196332184ae tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:11.645679 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9eb65a84-ec55-4c8f-b97d-5196332184ae tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1729 microversion: 2.20 time: 0.157856 Jan 18 20:29:11.646239 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 407/807] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:11 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:29:12.354949 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5c06c275-a378-40f5-910f-d6e8b4d1b6d2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:12.355605 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-5c06c275-a378-40f5-910f-d6e8b4d1b6d2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:12.362200 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5c06c275-a378-40f5-910f-d6e8b4d1b6d2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:12.362650 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5c06c275-a378-40f5-910f-d6e8b4d1b6d2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:12.363586 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5c06c275-a378-40f5-910f-d6e8b4d1b6d2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:12.363965 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5c06c275-a378-40f5-910f-d6e8b4d1b6d2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:12.502633 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-5c06c275-a378-40f5-910f-d6e8b4d1b6d2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:12.510361 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-5c06c275-a378-40f5-910f-d6e8b4d1b6d2 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1674 microversion: 2.1 time: 0.160496 Jan 18 20:29:12.510939 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 401/808] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:12 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:29:12.664876 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5b56e740-5a9a-4e2b-b35e-8a3fba06be19 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:12.665508 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5b56e740-5a9a-4e2b-b35e-8a3fba06be19 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:12.672639 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5b56e740-5a9a-4e2b-b35e-8a3fba06be19 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:12.673085 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5b56e740-5a9a-4e2b-b35e-8a3fba06be19 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:12.673865 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5b56e740-5a9a-4e2b-b35e-8a3fba06be19 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:12.674299 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5b56e740-5a9a-4e2b-b35e-8a3fba06be19 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:12.814227 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5b56e740-5a9a-4e2b-b35e-8a3fba06be19 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:12.822229 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5b56e740-5a9a-4e2b-b35e-8a3fba06be19 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:12.823752 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5b56e740-5a9a-4e2b-b35e-8a3fba06be19 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:12.826509 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5b56e740-5a9a-4e2b-b35e-8a3fba06be19 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1729 microversion: 2.20 time: 0.163822 Jan 18 20:29:12.826509 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 408/809] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:12 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:29:13.528599 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-cb76a0e5-a834-42c6-acf6-30c9b5c23189 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:13.529219 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-cb76a0e5-a834-42c6-acf6-30c9b5c23189 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:13.536090 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cb76a0e5-a834-42c6-acf6-30c9b5c23189 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:13.536543 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cb76a0e5-a834-42c6-acf6-30c9b5c23189 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:13.537343 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cb76a0e5-a834-42c6-acf6-30c9b5c23189 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:13.537791 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cb76a0e5-a834-42c6-acf6-30c9b5c23189 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:13.749144 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-cb76a0e5-a834-42c6-acf6-30c9b5c23189 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '526b24d5cecf4e078cd5188062e959f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56295fd7b6c447b4a143879d64dd49da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:13.756977 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-cb76a0e5-a834-42c6-acf6-30c9b5c23189 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 200 len: 1674 microversion: 2.1 time: 0.232718 Jan 18 20:29:13.757713 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 402/810] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:13 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 1674 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:29:13.846622 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-df3bd5f6-ae37-4445-b716-c45c603b4126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:13.856670 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-df3bd5f6-ae37-4445-b716-c45c603b4126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:13.864526 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df3bd5f6-ae37-4445-b716-c45c603b4126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:13.864976 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df3bd5f6-ae37-4445-b716-c45c603b4126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:13.865803 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df3bd5f6-ae37-4445-b716-c45c603b4126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:13.866238 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df3bd5f6-ae37-4445-b716-c45c603b4126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:14.003083 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-df3bd5f6-ae37-4445-b716-c45c603b4126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:14.011635 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-df3bd5f6-ae37-4445-b716-c45c603b4126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:14.013202 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-df3bd5f6-ae37-4445-b716-c45c603b4126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:14.014369 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-df3bd5f6-ae37-4445-b716-c45c603b4126 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1729 microversion: 2.20 time: 0.175035 Jan 18 20:29:14.014936 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 409/811] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:13 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:29:14.217956 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-cc82d6d2-580b-499d-b80c-c2f5bff2b702 req-1b8c3540-be22-49d6-b7b1-cf5d2fb69e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1b7d23-2dbd-4028-8c9e-6760c49670aa", "name": "network-vif-deleted", "tag": "ac71aa2f-ced3-4de1-af45-1e8fc62dff0f"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:29:14.221740 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:29:14.221740 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:29:14.234936 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-cc82d6d2-580b-499d-b80c-c2f5bff2b702 req-1b8c3540-be22-49d6-b7b1-cf5d2fb69e00 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:14.235790 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-cc82d6d2-580b-499d-b80c-c2f5bff2b702 req-1b8c3540-be22-49d6-b7b1-cf5d2fb69e00 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:14.262637 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-cc82d6d2-580b-499d-b80c-c2f5bff2b702 req-1b8c3540-be22-49d6-b7b1-cf5d2fb69e00 service nova] Creating event network-vif-deleted:ac71aa2f-ced3-4de1-af45-1e8fc62dff0f for instance ca1b7d23-2dbd-4028-8c9e-6760c49670aa on hv-cinder-82160 Jan 18 20:29:14.281615 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-cc82d6d2-580b-499d-b80c-c2f5bff2b702 req-1b8c3540-be22-49d6-b7b1-cf5d2fb69e00 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161040 Jan 18 20:29:14.282478 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 403/812] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:29:14.774338 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-14380084-821d-4517-ba7d-987f3ea37600 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:14.774852 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-14380084-821d-4517-ba7d-987f3ea37600 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:14.781561 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-14380084-821d-4517-ba7d-987f3ea37600 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:14.782005 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-14380084-821d-4517-ba7d-987f3ea37600 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:14.782786 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-14380084-821d-4517-ba7d-987f3ea37600 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:14.783243 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-14380084-821d-4517-ba7d-987f3ea37600 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:14.799064 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-14380084-821d-4517-ba7d-987f3ea37600 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] HTTP exception thrown: Instance ca1b7d23-2dbd-4028-8c9e-6760c49670aa could not be found. Jan 18 20:29:14.799845 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-14380084-821d-4517-ba7d-987f3ea37600 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Returning 404 to user: Instance ca1b7d23-2dbd-4028-8c9e-6760c49670aa could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:29:14.800674 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-14380084-821d-4517-ba7d-987f3ea37600 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 404 len: 111 microversion: 2.1 time: 0.030169 Jan 18 20:29:14.801238 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 410/813] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:14 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:29:14.810596 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-965304ce-a553-476a-8f11-e33302ac65f6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '.version_select at 0x7f1782cd0d30>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:14.831668 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-965304ce-a553-476a-8f11-e33302ac65f6 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881757113" status: 202 len: 0 microversion: 2.1 time: 0.025392 Jan 18 20:29:14.832246 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 404/814] 10.222.0.67 () {58 vars in 1220 bytes} [Tue Jan 18 20:29:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881757113 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:29:15.032131 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-30044455-2427-485c-9140-49fe798c7f2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:15.032979 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-30044455-2427-485c-9140-49fe798c7f2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:15.046028 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-30044455-2427-485c-9140-49fe798c7f2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:15.046731 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-30044455-2427-485c-9140-49fe798c7f2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:15.047755 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-30044455-2427-485c-9140-49fe798c7f2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:15.048185 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-30044455-2427-485c-9140-49fe798c7f2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:15.306922 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-30044455-2427-485c-9140-49fe798c7f2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:15.316218 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-30044455-2427-485c-9140-49fe798c7f2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:15.317900 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-30044455-2427-485c-9140-49fe798c7f2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:15.319357 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-30044455-2427-485c-9140-49fe798c7f2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1729 microversion: 2.20 time: 0.291693 Jan 18 20:29:15.319937 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 411/815] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:15 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1729 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:29:15.344721 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-2ae4ad18-571f-458b-8c0f-1552e1c8cfe6 req-838848e8-7fa4-4f28-a89e-deb05fd75698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d0afa1-510c-4954-8984-662702bb00dc", "name": "network-vif-plugged", "status": "completed", "tag": "40086b9f-1a65-40f2-9db4-6bf22c7ecd7d"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:29:15.348202 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:29:15.348202 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:29:15.363847 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-2ae4ad18-571f-458b-8c0f-1552e1c8cfe6 req-838848e8-7fa4-4f28-a89e-deb05fd75698 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:15.364641 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-2ae4ad18-571f-458b-8c0f-1552e1c8cfe6 req-838848e8-7fa4-4f28-a89e-deb05fd75698 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:15.388099 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-2ae4ad18-571f-458b-8c0f-1552e1c8cfe6 req-838848e8-7fa4-4f28-a89e-deb05fd75698 service nova] Creating event network-vif-plugged:40086b9f-1a65-40f2-9db4-6bf22c7ecd7d for instance c6d0afa1-510c-4954-8984-662702bb00dc on hv-cinder-82160 Jan 18 20:29:15.397596 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-2ae4ad18-571f-458b-8c0f-1552e1c8cfe6 req-838848e8-7fa4-4f28-a89e-deb05fd75698 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060548 Jan 18 20:29:15.398867 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 405/816] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:29:16.337877 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-83b79f5c-38e3-4414-a234-5fc05d4f71cd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:16.338488 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-83b79f5c-38e3-4414-a234-5fc05d4f71cd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:16.345413 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83b79f5c-38e3-4414-a234-5fc05d4f71cd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:16.345859 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83b79f5c-38e3-4414-a234-5fc05d4f71cd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:16.346634 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83b79f5c-38e3-4414-a234-5fc05d4f71cd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:16.347088 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83b79f5c-38e3-4414-a234-5fc05d4f71cd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:16.475562 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-83b79f5c-38e3-4414-a234-5fc05d4f71cd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:16.483145 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-83b79f5c-38e3-4414-a234-5fc05d4f71cd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:16.484625 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-83b79f5c-38e3-4414-a234-5fc05d4f71cd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:16.485756 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-83b79f5c-38e3-4414-a234-5fc05d4f71cd tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1729 microversion: 2.20 time: 0.151627 Jan 18 20:29:16.486297 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 412/817] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:16 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:29:17.504573 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a2859979-3b5f-48ae-b06c-4d224ebbe748 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:17.505270 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-a2859979-3b5f-48ae-b06c-4d224ebbe748 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:17.511399 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a2859979-3b5f-48ae-b06c-4d224ebbe748 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:17.511848 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a2859979-3b5f-48ae-b06c-4d224ebbe748 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:17.512619 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a2859979-3b5f-48ae-b06c-4d224ebbe748 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:17.513052 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a2859979-3b5f-48ae-b06c-4d224ebbe748 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:17.644926 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a2859979-3b5f-48ae-b06c-4d224ebbe748 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:17.652753 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a2859979-3b5f-48ae-b06c-4d224ebbe748 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:17.654237 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a2859979-3b5f-48ae-b06c-4d224ebbe748 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:17.655405 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a2859979-3b5f-48ae-b06c-4d224ebbe748 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1716 microversion: 2.20 time: 0.155326 Jan 18 20:29:17.655981 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 406/818] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:17 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:29:17.978699 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-536dde50-cc76-4c71-9438-0c467b487c0b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:17.979310 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-536dde50-cc76-4c71-9438-0c467b487c0b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:17.986164 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-536dde50-cc76-4c71-9438-0c467b487c0b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:17.986614 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-536dde50-cc76-4c71-9438-0c467b487c0b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:17.987428 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-536dde50-cc76-4c71-9438-0c467b487c0b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:17.987865 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-536dde50-cc76-4c71-9438-0c467b487c0b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:18.002307 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-536dde50-cc76-4c71-9438-0c467b487c0b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] HTTP exception thrown: Instance ca1b7d23-2dbd-4028-8c9e-6760c49670aa could not be found. Jan 18 20:29:18.002900 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-536dde50-cc76-4c71-9438-0c467b487c0b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Returning 404 to user: Instance ca1b7d23-2dbd-4028-8c9e-6760c49670aa could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:29:18.003807 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-536dde50-cc76-4c71-9438-0c467b487c0b tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 404 len: 111 microversion: 2.1 time: 0.028800 Jan 18 20:29:18.004368 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 413/819] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:29:17 2022] DELETE /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:29:18.012237 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f0837c56-2364-4044-92c4-bc8e0bfa973d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:18.012846 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-f0837c56-2364-4044-92c4-bc8e0bfa973d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: ca1b7d23-2dbd-4028-8c9e-6760c49670aa] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:18.019021 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f0837c56-2364-4044-92c4-bc8e0bfa973d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:18.019498 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f0837c56-2364-4044-92c4-bc8e0bfa973d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:18.020287 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f0837c56-2364-4044-92c4-bc8e0bfa973d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:18.020719 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f0837c56-2364-4044-92c4-bc8e0bfa973d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:18.034767 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-f0837c56-2364-4044-92c4-bc8e0bfa973d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] HTTP exception thrown: Instance ca1b7d23-2dbd-4028-8c9e-6760c49670aa could not be found. Jan 18 20:29:18.035388 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f0837c56-2364-4044-92c4-bc8e0bfa973d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Returning 404 to user: Instance ca1b7d23-2dbd-4028-8c9e-6760c49670aa could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:29:18.036221 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-f0837c56-2364-4044-92c4-bc8e0bfa973d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa" status: 404 len: 111 microversion: 2.1 time: 0.027664 Jan 18 20:29:18.036779 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 407/820] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:18 2022] GET /compute/v2.1/servers/ca1b7d23-2dbd-4028-8c9e-6760c49670aa => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:29:19.184166 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-13c6839e-4d0b-452a-807e-a0210f6cc4d5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:19.184740 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-13c6839e-4d0b-452a-807e-a0210f6cc4d5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:19.191749 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-13c6839e-4d0b-452a-807e-a0210f6cc4d5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:19.192202 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-13c6839e-4d0b-452a-807e-a0210f6cc4d5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:19.192996 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-13c6839e-4d0b-452a-807e-a0210f6cc4d5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:19.193429 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-13c6839e-4d0b-452a-807e-a0210f6cc4d5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:19.208717 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-13c6839e-4d0b-452a-807e-a0210f6cc4d5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] HTTP exception thrown: Instance b6e08025-ad66-4921-8672-ab55c85cbfb4 could not be found. Jan 18 20:29:19.209317 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-13c6839e-4d0b-452a-807e-a0210f6cc4d5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Returning 404 to user: Instance b6e08025-ad66-4921-8672-ab55c85cbfb4 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:29:19.210164 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-13c6839e-4d0b-452a-807e-a0210f6cc4d5 tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 404 len: 111 microversion: 2.1 time: 0.029747 Jan 18 20:29:19.210735 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 414/821] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:29:19 2022] DELETE /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:29:19.218958 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-8793efaf-7d55-420f-a269-659455b5836d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:19.219605 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-8793efaf-7d55-420f-a269-659455b5836d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] [instance: b6e08025-ad66-4921-8672-ab55c85cbfb4] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:19.226093 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8793efaf-7d55-420f-a269-659455b5836d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:19.226545 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8793efaf-7d55-420f-a269-659455b5836d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:19.227369 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8793efaf-7d55-420f-a269-659455b5836d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:19.227814 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8793efaf-7d55-420f-a269-659455b5836d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:19.242489 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-8793efaf-7d55-420f-a269-659455b5836d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] HTTP exception thrown: Instance b6e08025-ad66-4921-8672-ab55c85cbfb4 could not be found. Jan 18 20:29:19.243143 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-8793efaf-7d55-420f-a269-659455b5836d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] Returning 404 to user: Instance b6e08025-ad66-4921-8672-ab55c85cbfb4 could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:29:19.243988 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-8793efaf-7d55-420f-a269-659455b5836d tempest-AttachVolumeTestJSON-391984155 tempest-AttachVolumeTestJSON-391984155-project] 10.222.0.67 "GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4" status: 404 len: 111 microversion: 2.1 time: 0.028738 Jan 18 20:29:19.244547 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 408/822] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:19 2022] GET /compute/v2.1/servers/b6e08025-ad66-4921-8672-ab55c85cbfb4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:29:51.940698 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-72876f88-0134-4d39-bec5-013fb4a91c9a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:29:51.941283 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-72876f88-0134-4d39-bec5-013fb4a91c9a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:51.947375 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-72876f88-0134-4d39-bec5-013fb4a91c9a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:51.947817 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-72876f88-0134-4d39-bec5-013fb4a91c9a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:51.948578 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-72876f88-0134-4d39-bec5-013fb4a91c9a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:51.949009 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-72876f88-0134-4d39-bec5-013fb4a91c9a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:51.971915 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-72876f88-0134-4d39-bec5-013fb4a91c9a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lazy-loading 'flavor' on Instance uuid d3922fa1-08be-4eee-9088-5ccf7cf4014e {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:29:52.040217 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-2156f3ed-203d-454d-988a-e29519c45644 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:52.041278 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-2156f3ed-203d-454d-988a-e29519c45644 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:52.048567 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2156f3ed-203d-454d-988a-e29519c45644 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:52.048868 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-72876f88-0134-4d39-bec5-013fb4a91c9a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "POST /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e/action" status: 202 len: 0 microversion: 2.1 time: 0.111607 Jan 18 20:29:52.049014 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2156f3ed-203d-454d-988a-e29519c45644 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:52.049487 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 415/823] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:29:51 2022] POST /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:29:52.049807 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2156f3ed-203d-454d-988a-e29519c45644 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:52.050241 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2156f3ed-203d-454d-988a-e29519c45644 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:52.060589 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f1f8c096-49c9-4955-8032-af5449d2f1fe tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:52.061585 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f1f8c096-49c9-4955-8032-af5449d2f1fe tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:52.069183 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f1f8c096-49c9-4955-8032-af5449d2f1fe tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:52.069924 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f1f8c096-49c9-4955-8032-af5449d2f1fe tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:52.070753 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f1f8c096-49c9-4955-8032-af5449d2f1fe tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:52.071313 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f1f8c096-49c9-4955-8032-af5449d2f1fe tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:52.101142 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2156f3ed-203d-454d-988a-e29519c45644 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064809 Jan 18 20:29:52.102310 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 409/824] 10.222.0.67 () {60 vars in 1342 bytes} [Tue Jan 18 20:29:52 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:29:52.174375 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-84fa6c30-9c87-4424-a6b5-61cac6a7cead tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:52.174899 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-84fa6c30-9c87-4424-a6b5-61cac6a7cead tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:52.188823 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-84fa6c30-9c87-4424-a6b5-61cac6a7cead tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:52.189677 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-84fa6c30-9c87-4424-a6b5-61cac6a7cead tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:52.192203 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-84fa6c30-9c87-4424-a6b5-61cac6a7cead tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:52.192203 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-84fa6c30-9c87-4424-a6b5-61cac6a7cead tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:52.240511 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-84fa6c30-9c87-4424-a6b5-61cac6a7cead tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Going to try to terminate instance {{(pid=116376) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:29:52.254049 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f1f8c096-49c9-4955-8032-af5449d2f1fe tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:52.261867 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f1f8c096-49c9-4955-8032-af5449d2f1fe tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1567 microversion: 2.1 time: 0.206651 Jan 18 20:29:52.262953 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 416/825] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:52 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:29:52.329646 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-84fa6c30-9c87-4424-a6b5-61cac6a7cead tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 204 len: 0 microversion: 2.20 time: 0.164246 Jan 18 20:29:52.330287 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 410/826] 10.222.0.67 () {60 vars in 1279 bytes} [Tue Jan 18 20:29:52 2022] DELETE /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 18 20:29:52.338746 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c28b29a9-6f0e-45f9-8c2f-03f15a997ea4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:52.339419 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c28b29a9-6f0e-45f9-8c2f-03f15a997ea4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:52.346401 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c28b29a9-6f0e-45f9-8c2f-03f15a997ea4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:52.346845 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c28b29a9-6f0e-45f9-8c2f-03f15a997ea4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:52.347677 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c28b29a9-6f0e-45f9-8c2f-03f15a997ea4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:52.348113 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c28b29a9-6f0e-45f9-8c2f-03f15a997ea4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:52.496952 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c28b29a9-6f0e-45f9-8c2f-03f15a997ea4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:52.506224 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c28b29a9-6f0e-45f9-8c2f-03f15a997ea4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:52.507751 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c28b29a9-6f0e-45f9-8c2f-03f15a997ea4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:52.508908 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c28b29a9-6f0e-45f9-8c2f-03f15a997ea4 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1722 microversion: 2.20 time: 0.174100 Jan 18 20:29:52.509459 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 417/827] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:52 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:29:53.283607 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-c8f3ec9f-203a-4cb6-9b08-3f5a20d7d7d3 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:53.284306 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-c8f3ec9f-203a-4cb6-9b08-3f5a20d7d7d3 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:53.290708 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c8f3ec9f-203a-4cb6-9b08-3f5a20d7d7d3 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:53.291186 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c8f3ec9f-203a-4cb6-9b08-3f5a20d7d7d3 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:53.291971 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c8f3ec9f-203a-4cb6-9b08-3f5a20d7d7d3 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:53.292405 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c8f3ec9f-203a-4cb6-9b08-3f5a20d7d7d3 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:53.424967 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-c8f3ec9f-203a-4cb6-9b08-3f5a20d7d7d3 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:53.432528 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-c8f3ec9f-203a-4cb6-9b08-3f5a20d7d7d3 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1567 microversion: 2.1 time: 0.153437 Jan 18 20:29:53.433109 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 411/828] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:53 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:29:53.528825 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d205a414-3b02-4ab0-aa0f-a6e67b0dda7c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:53.529428 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d205a414-3b02-4ab0-aa0f-a6e67b0dda7c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:53.536433 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d205a414-3b02-4ab0-aa0f-a6e67b0dda7c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:53.536803 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d205a414-3b02-4ab0-aa0f-a6e67b0dda7c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:53.537576 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d205a414-3b02-4ab0-aa0f-a6e67b0dda7c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:53.538007 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d205a414-3b02-4ab0-aa0f-a6e67b0dda7c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:53.677048 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d205a414-3b02-4ab0-aa0f-a6e67b0dda7c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:53.685132 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d205a414-3b02-4ab0-aa0f-a6e67b0dda7c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:53.686666 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d205a414-3b02-4ab0-aa0f-a6e67b0dda7c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:53.687904 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d205a414-3b02-4ab0-aa0f-a6e67b0dda7c tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1722 microversion: 2.20 time: 0.162807 Jan 18 20:29:53.688819 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 418/829] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:53 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 18 20:29:54.448754 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-982801cf-0156-4ebd-87bd-e7d4b23fd12a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:54.449365 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-982801cf-0156-4ebd-87bd-e7d4b23fd12a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:54.458272 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-982801cf-0156-4ebd-87bd-e7d4b23fd12a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:54.458716 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-982801cf-0156-4ebd-87bd-e7d4b23fd12a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:54.459559 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-982801cf-0156-4ebd-87bd-e7d4b23fd12a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:54.460000 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-982801cf-0156-4ebd-87bd-e7d4b23fd12a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:54.673964 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-982801cf-0156-4ebd-87bd-e7d4b23fd12a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:54.681296 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-982801cf-0156-4ebd-87bd-e7d4b23fd12a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1567 microversion: 2.1 time: 0.236186 Jan 18 20:29:54.681800 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 412/830] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:54 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:29:54.707841 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c0fa58db-3cf2-4d14-ae59-495650b056e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:54.708592 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c0fa58db-3cf2-4d14-ae59-495650b056e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:54.715734 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0fa58db-3cf2-4d14-ae59-495650b056e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:54.716395 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0fa58db-3cf2-4d14-ae59-495650b056e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:54.717490 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0fa58db-3cf2-4d14-ae59-495650b056e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:54.718156 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0fa58db-3cf2-4d14-ae59-495650b056e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:54.794901 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c0fa58db-3cf2-4d14-ae59-495650b056e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:54.798285 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-e5f7c257-a07a-459c-9b37-b029477e9d3b req-a3011e5f-680a-430e-970e-3f132cd5eaff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d0afa1-510c-4954-8984-662702bb00dc", "name": "network-vif-deleted", "tag": "40086b9f-1a65-40f2-9db4-6bf22c7ecd7d"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:29:54.804538 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:29:54.804538 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:29:54.811503 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c0fa58db-3cf2-4d14-ae59-495650b056e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:54.813857 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-e5f7c257-a07a-459c-9b37-b029477e9d3b req-a3011e5f-680a-430e-970e-3f132cd5eaff service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:54.814539 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-e5f7c257-a07a-459c-9b37-b029477e9d3b req-a3011e5f-680a-430e-970e-3f132cd5eaff service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:54.814758 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c0fa58db-3cf2-4d14-ae59-495650b056e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b40e1486b9184e25b89c064fb56673df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6dd542180144d480be34c9a555ae63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:54.825835 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c0fa58db-3cf2-4d14-ae59-495650b056e6 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 200 len: 1655 microversion: 2.20 time: 0.121669 Jan 18 20:29:54.831664 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-e5f7c257-a07a-459c-9b37-b029477e9d3b req-a3011e5f-680a-430e-970e-3f132cd5eaff service nova] Creating event network-vif-deleted:40086b9f-1a65-40f2-9db4-6bf22c7ecd7d for instance c6d0afa1-510c-4954-8984-662702bb00dc on hv-cinder-82160 Jan 18 20:29:54.833050 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 419/831] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:54 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 1655 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 18 20:29:54.849346 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-e5f7c257-a07a-459c-9b37-b029477e9d3b req-a3011e5f-680a-430e-970e-3f132cd5eaff service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057172 Jan 18 20:29:54.850597 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 413/832] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:29:55.699098 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-13ca797a-7cb5-4f78-854e-f1fe292d39cf tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:55.699866 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-13ca797a-7cb5-4f78-854e-f1fe292d39cf tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:55.706682 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-13ca797a-7cb5-4f78-854e-f1fe292d39cf tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:55.707294 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-13ca797a-7cb5-4f78-854e-f1fe292d39cf tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:55.708161 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-13ca797a-7cb5-4f78-854e-f1fe292d39cf tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:55.709007 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-13ca797a-7cb5-4f78-854e-f1fe292d39cf tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:55.849320 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-13ca797a-7cb5-4f78-854e-f1fe292d39cf tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:55.850664 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-bbeffa9b-23df-45b2-b8b7-303981004c16 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:55.851943 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-bbeffa9b-23df-45b2-b8b7-303981004c16 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:55.856867 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-13ca797a-7cb5-4f78-854e-f1fe292d39cf tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1567 microversion: 2.1 time: 0.161590 Jan 18 20:29:55.857443 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 420/833] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:55 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:29:55.859331 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bbeffa9b-23df-45b2-b8b7-303981004c16 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:55.860007 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bbeffa9b-23df-45b2-b8b7-303981004c16 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:55.860790 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bbeffa9b-23df-45b2-b8b7-303981004c16 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:55.861224 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bbeffa9b-23df-45b2-b8b7-303981004c16 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:56.029646 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-bbeffa9b-23df-45b2-b8b7-303981004c16 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] HTTP exception thrown: Instance c6d0afa1-510c-4954-8984-662702bb00dc could not be found. Jan 18 20:29:56.030305 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-bbeffa9b-23df-45b2-b8b7-303981004c16 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Returning 404 to user: Instance c6d0afa1-510c-4954-8984-662702bb00dc could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:29:56.031273 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-bbeffa9b-23df-45b2-b8b7-303981004c16 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 404 len: 111 microversion: 2.20 time: 0.184756 Jan 18 20:29:56.031825 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 414/834] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:55 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 18 20:29:56.040758 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e421e889-19fb-4f8e-8879-9863ccb1af2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '.version_select at 0x7f178834e310>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:56.044128 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e421e889-19fb-4f8e-8879-9863ccb1af2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [39bc3590-5c56-479f-97da-455d45f511a3] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 18 20:29:56.873862 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e391a62e-13b3-4e8e-a8bc-b57ad4456fd5 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:56.875234 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e391a62e-13b3-4e8e-a8bc-b57ad4456fd5 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:56.882090 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e391a62e-13b3-4e8e-a8bc-b57ad4456fd5 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:56.882545 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e391a62e-13b3-4e8e-a8bc-b57ad4456fd5 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:56.883358 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e391a62e-13b3-4e8e-a8bc-b57ad4456fd5 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:56.883801 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e391a62e-13b3-4e8e-a8bc-b57ad4456fd5 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:57.052813 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO oslo.messaging._drivers.impl_rabbit [None req-e421e889-19fb-4f8e-8879-9863ccb1af2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [39bc3590-5c56-479f-97da-455d45f511a3] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 41268. Jan 18 20:29:57.072657 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e421e889-19fb-4f8e-8879-9863ccb1af2a tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1590711183" status: 204 len: 0 microversion: 2.20 time: 1.035559 Jan 18 20:29:57.073253 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 421/835] 10.222.0.67 () {60 vars in 1261 bytes} [Tue Jan 18 20:29:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1590711183 => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 18 20:29:57.262182 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-e391a62e-13b3-4e8e-a8bc-b57ad4456fd5 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:57.271230 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e391a62e-13b3-4e8e-a8bc-b57ad4456fd5 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1567 microversion: 2.1 time: 0.400995 Jan 18 20:29:57.271846 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 415/836] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:56 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1567 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:29:58.289462 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-dc313624-9d85-4d90-b226-271fb71e662c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:58.290009 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-dc313624-9d85-4d90-b226-271fb71e662c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:58.297637 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dc313624-9d85-4d90-b226-271fb71e662c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:58.298082 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dc313624-9d85-4d90-b226-271fb71e662c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:58.298867 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dc313624-9d85-4d90-b226-271fb71e662c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:58.299334 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dc313624-9d85-4d90-b226-271fb71e662c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:58.429840 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-dc313624-9d85-4d90-b226-271fb71e662c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:58.437741 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-dc313624-9d85-4d90-b226-271fb71e662c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1567 microversion: 2.1 time: 0.152071 Jan 18 20:29:58.438304 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 422/837] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:58 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:29:58.840603 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-1a3255dc-cd56-4459-81e2-0c715717ca7d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:58.841166 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-1a3255dc-cd56-4459-81e2-0c715717ca7d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:58.848683 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1a3255dc-cd56-4459-81e2-0c715717ca7d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:58.849154 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1a3255dc-cd56-4459-81e2-0c715717ca7d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:58.849932 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1a3255dc-cd56-4459-81e2-0c715717ca7d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:58.850432 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1a3255dc-cd56-4459-81e2-0c715717ca7d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:58.865639 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-1a3255dc-cd56-4459-81e2-0c715717ca7d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] HTTP exception thrown: Instance c6d0afa1-510c-4954-8984-662702bb00dc could not be found. Jan 18 20:29:58.866239 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-1a3255dc-cd56-4459-81e2-0c715717ca7d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Returning 404 to user: Instance c6d0afa1-510c-4954-8984-662702bb00dc could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:29:58.867087 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-1a3255dc-cd56-4459-81e2-0c715717ca7d tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 404 len: 111 microversion: 2.20 time: 0.030207 Jan 18 20:29:58.867640 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 416/838] 10.222.0.67 () {60 vars in 1279 bytes} [Tue Jan 18 20:29:58 2022] DELETE /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 18 20:29:58.875377 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f2067a4a-ccb9-4fc1-a35a-0abd184022b0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:58.875978 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f2067a4a-ccb9-4fc1-a35a-0abd184022b0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: c6d0afa1-510c-4954-8984-662702bb00dc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:58.881984 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f2067a4a-ccb9-4fc1-a35a-0abd184022b0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:58.882420 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f2067a4a-ccb9-4fc1-a35a-0abd184022b0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:58.883231 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f2067a4a-ccb9-4fc1-a35a-0abd184022b0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:58.883660 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f2067a4a-ccb9-4fc1-a35a-0abd184022b0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:58.901638 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-f2067a4a-ccb9-4fc1-a35a-0abd184022b0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] HTTP exception thrown: Instance c6d0afa1-510c-4954-8984-662702bb00dc could not be found. Jan 18 20:29:58.902228 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f2067a4a-ccb9-4fc1-a35a-0abd184022b0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Returning 404 to user: Instance c6d0afa1-510c-4954-8984-662702bb00dc could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:29:58.903078 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f2067a4a-ccb9-4fc1-a35a-0abd184022b0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc" status: 404 len: 111 microversion: 2.20 time: 0.031413 Jan 18 20:29:58.903642 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 423/839] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:29:58 2022] GET /compute/v2.1/servers/c6d0afa1-510c-4954-8984-662702bb00dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 18 20:29:59.454106 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-bf1003c1-a235-4cb7-8043-edd57c517f36 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:29:59.454703 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-bf1003c1-a235-4cb7-8043-edd57c517f36 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:29:59.460783 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bf1003c1-a235-4cb7-8043-edd57c517f36 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:59.461209 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bf1003c1-a235-4cb7-8043-edd57c517f36 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:59.461989 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bf1003c1-a235-4cb7-8043-edd57c517f36 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:29:59.462420 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bf1003c1-a235-4cb7-8043-edd57c517f36 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:29:59.589425 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-bf1003c1-a235-4cb7-8043-edd57c517f36 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:29:59.596691 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-bf1003c1-a235-4cb7-8043-edd57c517f36 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1567 microversion: 2.1 time: 0.146823 Jan 18 20:29:59.597236 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 417/840] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:29:59 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:00.614273 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4b735581-11bc-4f9c-8327-89df5b51e357 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:00.614884 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4b735581-11bc-4f9c-8327-89df5b51e357 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:00.621493 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4b735581-11bc-4f9c-8327-89df5b51e357 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:00.621939 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4b735581-11bc-4f9c-8327-89df5b51e357 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:00.622720 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4b735581-11bc-4f9c-8327-89df5b51e357 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:00.623184 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4b735581-11bc-4f9c-8327-89df5b51e357 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:00.756941 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4b735581-11bc-4f9c-8327-89df5b51e357 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:00.764321 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4b735581-11bc-4f9c-8327-89df5b51e357 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1567 microversion: 2.1 time: 0.154312 Jan 18 20:30:00.765479 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 424/841] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:00 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:01.082492 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-435d0ff3-b61f-4537-b58a-cf692433cdf0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:01.083072 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-435d0ff3-b61f-4537-b58a-cf692433cdf0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:01.090547 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-435d0ff3-b61f-4537-b58a-cf692433cdf0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:01.091050 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-435d0ff3-b61f-4537-b58a-cf692433cdf0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:01.091875 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-435d0ff3-b61f-4537-b58a-cf692433cdf0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:01.092316 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-435d0ff3-b61f-4537-b58a-cf692433cdf0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:01.107431 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-435d0ff3-b61f-4537-b58a-cf692433cdf0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] HTTP exception thrown: Instance 54f16911-8813-49b1-a940-9d83c6a5b131 could not be found. Jan 18 20:30:01.109571 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-435d0ff3-b61f-4537-b58a-cf692433cdf0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Returning 404 to user: Instance 54f16911-8813-49b1-a940-9d83c6a5b131 could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:30:01.110971 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-435d0ff3-b61f-4537-b58a-cf692433cdf0 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "DELETE /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 404 len: 111 microversion: 2.20 time: 0.032055 Jan 18 20:30:01.114890 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 418/842] 10.222.0.67 () {60 vars in 1279 bytes} [Tue Jan 18 20:30:01 2022] DELETE /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 18 20:30:01.120063 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-388aac9c-194b-4dfe-9373-4d4e73497887 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:01.120966 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-388aac9c-194b-4dfe-9373-4d4e73497887 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] [instance: 54f16911-8813-49b1-a940-9d83c6a5b131] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:01.127346 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-388aac9c-194b-4dfe-9373-4d4e73497887 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:01.128146 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-388aac9c-194b-4dfe-9373-4d4e73497887 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:01.129164 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-388aac9c-194b-4dfe-9373-4d4e73497887 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:01.129654 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-388aac9c-194b-4dfe-9373-4d4e73497887 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:01.145096 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-388aac9c-194b-4dfe-9373-4d4e73497887 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] HTTP exception thrown: Instance 54f16911-8813-49b1-a940-9d83c6a5b131 could not be found. Jan 18 20:30:01.145924 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-388aac9c-194b-4dfe-9373-4d4e73497887 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] Returning 404 to user: Instance 54f16911-8813-49b1-a940-9d83c6a5b131 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:30:01.146973 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-388aac9c-194b-4dfe-9373-4d4e73497887 tempest-AttachVolumeShelveTestJSON-238718596 tempest-AttachVolumeShelveTestJSON-238718596-project] 10.222.0.67 "GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131" status: 404 len: 111 microversion: 2.20 time: 0.030660 Jan 18 20:30:01.147571 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 425/843] 10.222.0.67 () {60 vars in 1276 bytes} [Tue Jan 18 20:30:01 2022] GET /compute/v2.1/servers/54f16911-8813-49b1-a940-9d83c6a5b131 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 18 20:30:01.782652 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-de604972-e63e-4bba-83a1-2e961664898e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:01.783596 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-de604972-e63e-4bba-83a1-2e961664898e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:01.791463 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-de604972-e63e-4bba-83a1-2e961664898e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:01.791903 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-de604972-e63e-4bba-83a1-2e961664898e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:01.792960 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-de604972-e63e-4bba-83a1-2e961664898e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:01.793308 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-de604972-e63e-4bba-83a1-2e961664898e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:02.020122 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-de604972-e63e-4bba-83a1-2e961664898e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:02.027916 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-de604972-e63e-4bba-83a1-2e961664898e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1567 microversion: 2.1 time: 0.249023 Jan 18 20:30:02.028632 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 419/844] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:01 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:03.048959 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b8c17ecf-c7d8-46e1-b4b9-2dd53e67592d tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:03.049587 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b8c17ecf-c7d8-46e1-b4b9-2dd53e67592d tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:03.056274 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b8c17ecf-c7d8-46e1-b4b9-2dd53e67592d tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:03.056724 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b8c17ecf-c7d8-46e1-b4b9-2dd53e67592d tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:03.057516 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b8c17ecf-c7d8-46e1-b4b9-2dd53e67592d tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:03.057951 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b8c17ecf-c7d8-46e1-b4b9-2dd53e67592d tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:03.197282 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b8c17ecf-c7d8-46e1-b4b9-2dd53e67592d tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:03.205937 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b8c17ecf-c7d8-46e1-b4b9-2dd53e67592d tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1567 microversion: 2.1 time: 0.160829 Jan 18 20:30:03.206547 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 426/845] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:03 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:04.228198 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-228ce380-53df-4fa1-a8e4-d31b08b4048f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:04.229442 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-228ce380-53df-4fa1-a8e4-d31b08b4048f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:04.238100 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-228ce380-53df-4fa1-a8e4-d31b08b4048f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:04.238879 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-228ce380-53df-4fa1-a8e4-d31b08b4048f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:04.239717 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-228ce380-53df-4fa1-a8e4-d31b08b4048f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:04.240155 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-228ce380-53df-4fa1-a8e4-d31b08b4048f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:04.570620 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-228ce380-53df-4fa1-a8e4-d31b08b4048f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:04.579680 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-228ce380-53df-4fa1-a8e4-d31b08b4048f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1567 microversion: 2.1 time: 0.359312 Jan 18 20:30:04.580287 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 420/846] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:04 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1567 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:05.601846 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c5a6ea66-9e6a-4082-aced-56dfcd994a0f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:05.603155 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c5a6ea66-9e6a-4082-aced-56dfcd994a0f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:05.616971 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c5a6ea66-9e6a-4082-aced-56dfcd994a0f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:05.617634 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c5a6ea66-9e6a-4082-aced-56dfcd994a0f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:05.618421 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c5a6ea66-9e6a-4082-aced-56dfcd994a0f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:05.618845 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c5a6ea66-9e6a-4082-aced-56dfcd994a0f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:05.878791 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c5a6ea66-9e6a-4082-aced-56dfcd994a0f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:05.888230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c5a6ea66-9e6a-4082-aced-56dfcd994a0f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1508 microversion: 2.1 time: 0.292960 Jan 18 20:30:05.890651 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 427/847] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:05 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1508 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:05.907589 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-9b932284-621b-4999-bf6c-ed4ea40955cb tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:30:05.908188 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-9b932284-621b-4999-bf6c-ed4ea40955cb tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:05.915577 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9b932284-621b-4999-bf6c-ed4ea40955cb tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:05.916081 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9b932284-621b-4999-bf6c-ed4ea40955cb tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:05.917362 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9b932284-621b-4999-bf6c-ed4ea40955cb tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:05.917807 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9b932284-621b-4999-bf6c-ed4ea40955cb tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:06.027451 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-9b932284-621b-4999-bf6c-ed4ea40955cb tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "POST /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e/action" status: 202 len: 0 microversion: 2.1 time: 0.124014 Jan 18 20:30:06.028417 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 421/848] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:30:05 2022] POST /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:30:06.037653 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-837773de-f9a3-4281-ba3a-85f84ea3945c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:06.040785 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-837773de-f9a3-4281-ba3a-85f84ea3945c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:06.045586 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-837773de-f9a3-4281-ba3a-85f84ea3945c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:06.046547 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-837773de-f9a3-4281-ba3a-85f84ea3945c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:06.047411 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-837773de-f9a3-4281-ba3a-85f84ea3945c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:06.048280 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-837773de-f9a3-4281-ba3a-85f84ea3945c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:06.394986 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-837773de-f9a3-4281-ba3a-85f84ea3945c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:06.407237 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-837773de-f9a3-4281-ba3a-85f84ea3945c tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1516 microversion: 2.1 time: 0.374053 Jan 18 20:30:06.409977 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 428/849] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:06 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1516 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:07.427313 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-1176a5fc-1b09-4a25-a2d0-1991f43e55cb tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:07.428591 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-1176a5fc-1b09-4a25-a2d0-1991f43e55cb tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:07.437157 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1176a5fc-1b09-4a25-a2d0-1991f43e55cb tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:07.437802 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1176a5fc-1b09-4a25-a2d0-1991f43e55cb tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:07.438758 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1176a5fc-1b09-4a25-a2d0-1991f43e55cb tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:07.439393 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1176a5fc-1b09-4a25-a2d0-1991f43e55cb tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:07.658537 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-1176a5fc-1b09-4a25-a2d0-1991f43e55cb tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:07.668323 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-1176a5fc-1b09-4a25-a2d0-1991f43e55cb tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1518 microversion: 2.1 time: 0.244148 Jan 18 20:30:07.671076 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 422/850] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:07 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1518 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:07.680882 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-19fe5784-96bb-4988-ad14-0e0bd1c52409 req-b34e8178-b027-4833-a655-37b3cb9c7006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3922fa1-08be-4eee-9088-5ccf7cf4014e", "name": "network-vif-unplugged", "status": "completed", "tag": "f1f716af-ae09-4a01-8a29-d7bb8bff9321"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:30:07.683296 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:30:07.683296 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:30:07.698506 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-19fe5784-96bb-4988-ad14-0e0bd1c52409 req-b34e8178-b027-4833-a655-37b3cb9c7006 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:07.701023 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-19fe5784-96bb-4988-ad14-0e0bd1c52409 req-b34e8178-b027-4833-a655-37b3cb9c7006 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:07.725608 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-19fe5784-96bb-4988-ad14-0e0bd1c52409 req-b34e8178-b027-4833-a655-37b3cb9c7006 service nova] Creating event network-vif-unplugged:f1f716af-ae09-4a01-8a29-d7bb8bff9321 for instance d3922fa1-08be-4eee-9088-5ccf7cf4014e on hv-cinder-82160 Jan 18 20:30:07.735506 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-19fe5784-96bb-4988-ad14-0e0bd1c52409 req-b34e8178-b027-4833-a655-37b3cb9c7006 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060110 Jan 18 20:30:07.738772 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 429/851] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:30:08.075528 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-42b30280-bd34-426c-bb38-74f078c1c8de tempest-VolumesGetTestJSON-548344018 tempest-VolumesGetTestJSON-548344018-project] Action: 'create', calling method: .version_select at 0x7f1782d9e670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-954016501", "metadata": {"Type": "work"}}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:30:08.402110 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-42b30280-bd34-426c-bb38-74f078c1c8de tempest-VolumesGetTestJSON-548344018 tempest-VolumesGetTestJSON-548344018-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.612721 Jan 18 20:30:08.413085 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 423/852] 10.222.0.67 () {60 vars in 1155 bytes} [Tue Jan 18 20:30:07 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 624 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 18 20:30:08.415378 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c1857927-2c13-4091-9c58-5fb7f4d17549 tempest-VolumesGetTestJSON-548344018 tempest-VolumesGetTestJSON-548344018-project] Calling method '.version_select at 0x7f1782d968b0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:08.468424 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c1857927-2c13-4091-9c58-5fb7f4d17549 tempest-VolumesGetTestJSON-548344018 tempest-VolumesGetTestJSON-548344018-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/d5aa10e8-34a5-4e40-9026-8964ba65148b" status: 200 len: 352 microversion: 2.1 time: 0.057219 Jan 18 20:30:08.474175 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 430/853] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Jan 18 20:30:08 2022] GET /compute/v2.1/os-volumes/d5aa10e8-34a5-4e40-9026-8964ba65148b => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:30:08.687855 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a3a982f6-cf8e-4618-bd75-95bb0851d40e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:08.688861 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-a3a982f6-cf8e-4618-bd75-95bb0851d40e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:08.696342 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a3a982f6-cf8e-4618-bd75-95bb0851d40e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:08.696793 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a3a982f6-cf8e-4618-bd75-95bb0851d40e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:08.697948 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a3a982f6-cf8e-4618-bd75-95bb0851d40e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:08.698807 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a3a982f6-cf8e-4618-bd75-95bb0851d40e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:08.844053 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a3a982f6-cf8e-4618-bd75-95bb0851d40e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:08.852241 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a3a982f6-cf8e-4618-bd75-95bb0851d40e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1574 microversion: 2.1 time: 0.169581 Jan 18 20:30:08.855066 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 424/854] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:08 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:09.481841 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-28674db3-8d1f-4d45-8b90-f11584e2074d tempest-VolumesGetTestJSON-548344018 tempest-VolumesGetTestJSON-548344018-project] Calling method '.version_select at 0x7f1782d285e0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:09.528120 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-28674db3-8d1f-4d45-8b90-f11584e2074d tempest-VolumesGetTestJSON-548344018 tempest-VolumesGetTestJSON-548344018-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/d5aa10e8-34a5-4e40-9026-8964ba65148b" status: 200 len: 353 microversion: 2.1 time: 0.050460 Jan 18 20:30:09.528681 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 431/855] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Jan 18 20:30:09 2022] GET /compute/v2.1/os-volumes/d5aa10e8-34a5-4e40-9026-8964ba65148b => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:30:09.539290 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-68540464-968d-4ce9-be01-e8835bef069e tempest-VolumesGetTestJSON-548344018 tempest-VolumesGetTestJSON-548344018-project] Calling method '.version_select at 0x7f1782dfd040>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:09.591284 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-68540464-968d-4ce9-be01-e8835bef069e tempest-VolumesGetTestJSON-548344018 tempest-VolumesGetTestJSON-548344018-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/d5aa10e8-34a5-4e40-9026-8964ba65148b" status: 200 len: 353 microversion: 2.1 time: 0.055556 Jan 18 20:30:09.591864 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 425/856] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Jan 18 20:30:09 2022] GET /compute/v2.1/os-volumes/d5aa10e8-34a5-4e40-9026-8964ba65148b => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:30:09.607810 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5d436f00-6678-4955-9271-c1b4b8899c62 tempest-VolumesGetTestJSON-548344018 tempest-VolumesGetTestJSON-548344018-project] Calling method '.version_select at 0x7f1782dfcd30>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:09.669042 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5d436f00-6678-4955-9271-c1b4b8899c62 tempest-VolumesGetTestJSON-548344018 tempest-VolumesGetTestJSON-548344018-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/d5aa10e8-34a5-4e40-9026-8964ba65148b" status: 202 len: 0 microversion: 2.1 time: 0.064744 Jan 18 20:30:09.673536 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 432/857] 10.222.0.67 () {58 vars in 1247 bytes} [Tue Jan 18 20:30:09 2022] DELETE /compute/v2.1/os-volumes/d5aa10e8-34a5-4e40-9026-8964ba65148b => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:30:09.679009 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f57a5f89-8f09-4648-84c0-cf26fe9d6fe0 tempest-VolumesGetTestJSON-548344018 tempest-VolumesGetTestJSON-548344018-project] Calling method '.version_select at 0x7f1782d9e940>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:09.730397 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-f57a5f89-8f09-4648-84c0-cf26fe9d6fe0 tempest-VolumesGetTestJSON-548344018 tempest-VolumesGetTestJSON-548344018-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/d5aa10e8-34a5-4e40-9026-8964ba65148b" status: 200 len: 352 microversion: 2.1 time: 0.056063 Jan 18 20:30:09.730958 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 426/858] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Jan 18 20:30:09 2022] GET /compute/v2.1/os-volumes/d5aa10e8-34a5-4e40-9026-8964ba65148b => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:30:09.868976 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f29b68c7-94d9-4532-aa06-8a764005bdf0 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:09.869556 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f29b68c7-94d9-4532-aa06-8a764005bdf0 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:09.876422 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f29b68c7-94d9-4532-aa06-8a764005bdf0 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:09.877333 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f29b68c7-94d9-4532-aa06-8a764005bdf0 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:09.877691 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f29b68c7-94d9-4532-aa06-8a764005bdf0 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:09.878097 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f29b68c7-94d9-4532-aa06-8a764005bdf0 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:10.019745 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f29b68c7-94d9-4532-aa06-8a764005bdf0 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:10.027481 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f29b68c7-94d9-4532-aa06-8a764005bdf0 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1574 microversion: 2.1 time: 0.162400 Jan 18 20:30:10.028043 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 433/859] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:09 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:30:10.743184 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4618cbd2-9fce-49f4-82c4-ad9348155a1f tempest-VolumesGetTestJSON-548344018 tempest-VolumesGetTestJSON-548344018-project] Calling method '.version_select at 0x7f1782d749d0>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:10.770177 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-4618cbd2-9fce-49f4-82c4-ad9348155a1f tempest-VolumesGetTestJSON-548344018 tempest-VolumesGetTestJSON-548344018-project] HTTP exception thrown: Volume d5aa10e8-34a5-4e40-9026-8964ba65148b could not be found. Jan 18 20:30:10.770774 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4618cbd2-9fce-49f4-82c4-ad9348155a1f tempest-VolumesGetTestJSON-548344018 tempest-VolumesGetTestJSON-548344018-project] Returning 404 to user: Volume d5aa10e8-34a5-4e40-9026-8964ba65148b could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:30:10.771626 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-4618cbd2-9fce-49f4-82c4-ad9348155a1f tempest-VolumesGetTestJSON-548344018 tempest-VolumesGetTestJSON-548344018-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/d5aa10e8-34a5-4e40-9026-8964ba65148b" status: 404 len: 109 microversion: 2.1 time: 0.032548 Jan 18 20:30:10.775377 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 427/860] 10.222.0.67 () {58 vars in 1244 bytes} [Tue Jan 18 20:30:10 2022] GET /compute/v2.1/os-volumes/d5aa10e8-34a5-4e40-9026-8964ba65148b => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:30:11.045609 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-dd54dfc3-3cbd-4290-905e-03210353f5ab tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:11.046478 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-dd54dfc3-3cbd-4290-905e-03210353f5ab tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:11.052754 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd54dfc3-3cbd-4290-905e-03210353f5ab tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:11.053268 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd54dfc3-3cbd-4290-905e-03210353f5ab tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:11.054069 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd54dfc3-3cbd-4290-905e-03210353f5ab tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:11.054515 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd54dfc3-3cbd-4290-905e-03210353f5ab tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:11.232829 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-dd54dfc3-3cbd-4290-905e-03210353f5ab tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:11.241824 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-dd54dfc3-3cbd-4290-905e-03210353f5ab tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1574 microversion: 2.1 time: 0.199708 Jan 18 20:30:11.242432 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 434/861] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:11 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1574 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:12.261635 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-216b11f2-c21a-46cc-adfe-75a8d65dee33 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:12.261635 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-216b11f2-c21a-46cc-adfe-75a8d65dee33 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:12.271991 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-216b11f2-c21a-46cc-adfe-75a8d65dee33 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:12.272447 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-216b11f2-c21a-46cc-adfe-75a8d65dee33 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:12.273260 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-216b11f2-c21a-46cc-adfe-75a8d65dee33 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:12.273700 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-216b11f2-c21a-46cc-adfe-75a8d65dee33 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:12.464199 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-216b11f2-c21a-46cc-adfe-75a8d65dee33 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:12.472226 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-216b11f2-c21a-46cc-adfe-75a8d65dee33 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1574 microversion: 2.1 time: 0.215203 Jan 18 20:30:12.473708 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 428/862] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:12 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1574 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:30:13.501738 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-391f01e8-0ec9-499f-87cd-f4acc1146175 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:13.502529 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-391f01e8-0ec9-499f-87cd-f4acc1146175 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:13.515179 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-391f01e8-0ec9-499f-87cd-f4acc1146175 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:13.515911 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-391f01e8-0ec9-499f-87cd-f4acc1146175 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:13.516631 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-391f01e8-0ec9-499f-87cd-f4acc1146175 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:13.517074 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-391f01e8-0ec9-499f-87cd-f4acc1146175 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:13.687859 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-391f01e8-0ec9-499f-87cd-f4acc1146175 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:13.702059 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-391f01e8-0ec9-499f-87cd-f4acc1146175 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1574 microversion: 2.1 time: 0.204829 Jan 18 20:30:13.703487 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 435/863] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:13 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1574 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:14.721500 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7618ccbe-0b02-4098-96a1-415185c2e0c9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:14.722148 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-7618ccbe-0b02-4098-96a1-415185c2e0c9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:14.728617 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7618ccbe-0b02-4098-96a1-415185c2e0c9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:14.729074 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7618ccbe-0b02-4098-96a1-415185c2e0c9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:14.730156 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7618ccbe-0b02-4098-96a1-415185c2e0c9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:14.730599 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7618ccbe-0b02-4098-96a1-415185c2e0c9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:14.897274 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-7618ccbe-0b02-4098-96a1-415185c2e0c9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:14.909591 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7618ccbe-0b02-4098-96a1-415185c2e0c9 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1574 microversion: 2.1 time: 0.191751 Jan 18 20:30:14.910167 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 429/864] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:14 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1574 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:15.934494 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-200275c3-978a-4a42-84bc-2e9e69cb834f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:15.935415 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-200275c3-978a-4a42-84bc-2e9e69cb834f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:15.942288 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-200275c3-978a-4a42-84bc-2e9e69cb834f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:15.943007 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-200275c3-978a-4a42-84bc-2e9e69cb834f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:15.943991 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-200275c3-978a-4a42-84bc-2e9e69cb834f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:15.944420 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-200275c3-978a-4a42-84bc-2e9e69cb834f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:16.157340 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-200275c3-978a-4a42-84bc-2e9e69cb834f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:16.170325 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-200275c3-978a-4a42-84bc-2e9e69cb834f tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1574 microversion: 2.1 time: 0.242937 Jan 18 20:30:16.173630 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 436/865] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:15 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1574 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:17.195249 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4f215c4c-e29e-45c0-81fc-dc3927a8fc5e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:17.195877 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-4f215c4c-e29e-45c0-81fc-dc3927a8fc5e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:17.204092 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4f215c4c-e29e-45c0-81fc-dc3927a8fc5e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:17.204612 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4f215c4c-e29e-45c0-81fc-dc3927a8fc5e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:17.205724 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4f215c4c-e29e-45c0-81fc-dc3927a8fc5e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:17.206294 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4f215c4c-e29e-45c0-81fc-dc3927a8fc5e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:17.362793 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-4f215c4c-e29e-45c0-81fc-dc3927a8fc5e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:17.370452 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-4f215c4c-e29e-45c0-81fc-dc3927a8fc5e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1574 microversion: 2.1 time: 0.178930 Jan 18 20:30:17.371025 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 430/866] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:17 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:30:18.390826 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-647fc616-436b-4392-b7f6-c027168ae78a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:18.393009 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-647fc616-436b-4392-b7f6-c027168ae78a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:18.401709 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-647fc616-436b-4392-b7f6-c027168ae78a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:18.402794 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-647fc616-436b-4392-b7f6-c027168ae78a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:18.403798 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-647fc616-436b-4392-b7f6-c027168ae78a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:18.404391 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-647fc616-436b-4392-b7f6-c027168ae78a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:18.621935 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-647fc616-436b-4392-b7f6-c027168ae78a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:18.633376 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-647fc616-436b-4392-b7f6-c027168ae78a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1574 microversion: 2.1 time: 0.249895 Jan 18 20:30:18.634039 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 437/867] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:18 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1574 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:19.661129 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b5f3239a-7965-448d-ae63-d68284f6ab52 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:19.662188 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b5f3239a-7965-448d-ae63-d68284f6ab52 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:19.674182 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b5f3239a-7965-448d-ae63-d68284f6ab52 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:19.675004 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b5f3239a-7965-448d-ae63-d68284f6ab52 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:19.676362 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b5f3239a-7965-448d-ae63-d68284f6ab52 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:19.677111 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b5f3239a-7965-448d-ae63-d68284f6ab52 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:19.903865 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b5f3239a-7965-448d-ae63-d68284f6ab52 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:19.915819 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b5f3239a-7965-448d-ae63-d68284f6ab52 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1574 microversion: 2.1 time: 0.261311 Jan 18 20:30:19.918352 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 431/868] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:19 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1574 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:20.500097 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-185ed9a3-629a-4a2a-a703-3c9669b5d92a req-1919f907-5211-43db-87a1-efc1a4a73a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3922fa1-08be-4eee-9088-5ccf7cf4014e", "name": "network-vif-plugged", "status": "completed", "tag": "f1f716af-ae09-4a01-8a29-d7bb8bff9321"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:30:20.502081 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:30:20.502081 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:30:20.510799 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-185ed9a3-629a-4a2a-a703-3c9669b5d92a req-1919f907-5211-43db-87a1-efc1a4a73a07 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:20.511451 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-185ed9a3-629a-4a2a-a703-3c9669b5d92a req-1919f907-5211-43db-87a1-efc1a4a73a07 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:20.526453 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-185ed9a3-629a-4a2a-a703-3c9669b5d92a req-1919f907-5211-43db-87a1-efc1a4a73a07 service nova] Creating event network-vif-plugged:f1f716af-ae09-4a01-8a29-d7bb8bff9321 for instance d3922fa1-08be-4eee-9088-5ccf7cf4014e on hv-cinder-82160 Jan 18 20:30:20.533117 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-185ed9a3-629a-4a2a-a703-3c9669b5d92a req-1919f907-5211-43db-87a1-efc1a4a73a07 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036745 Jan 18 20:30:20.533756 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 438/869] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:30:20.944134 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-bf5a135f-2671-4d0b-a332-bbe45b6ee6b1 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:20.945033 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-bf5a135f-2671-4d0b-a332-bbe45b6ee6b1 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:20.953958 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bf5a135f-2671-4d0b-a332-bbe45b6ee6b1 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:20.954464 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bf5a135f-2671-4d0b-a332-bbe45b6ee6b1 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:20.955358 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bf5a135f-2671-4d0b-a332-bbe45b6ee6b1 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:20.955848 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bf5a135f-2671-4d0b-a332-bbe45b6ee6b1 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:21.158113 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-bf5a135f-2671-4d0b-a332-bbe45b6ee6b1 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:21.169222 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-bf5a135f-2671-4d0b-a332-bbe45b6ee6b1 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1574 microversion: 2.1 time: 0.230797 Jan 18 20:30:21.169967 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 432/870] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:20 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1574 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:22.195695 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c8ce12ba-7481-462f-bc5a-97c4a880287a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:22.198619 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c8ce12ba-7481-462f-bc5a-97c4a880287a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:22.210315 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c8ce12ba-7481-462f-bc5a-97c4a880287a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:22.211601 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c8ce12ba-7481-462f-bc5a-97c4a880287a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:22.213475 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c8ce12ba-7481-462f-bc5a-97c4a880287a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:22.214104 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c8ce12ba-7481-462f-bc5a-97c4a880287a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:22.457289 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c8ce12ba-7481-462f-bc5a-97c4a880287a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:22.477191 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c8ce12ba-7481-462f-bc5a-97c4a880287a tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1561 microversion: 2.1 time: 0.292377 Jan 18 20:30:22.478170 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 439/871] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:22 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1561 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:30:38.425683 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-12cbd7f4-561d-4fca-996b-026c1431936d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1883440218", "imageRef": "c7d259ac-b206-430f-a3c0-794cee408236", "flavorRef": "452", "networks": [{"uuid": "6a078bd6-d1cf-4974-abca-9ca9f02026e1"}]}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:30:38.484012 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.network.neutron [None req-12cbd7f4-561d-4fca-996b-026c1431936d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] validate_networks() for [('6a078bd6-d1cf-4974-abca-9ca9f02026e1', None, None, None, None, None)] {{(pid=116376) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:30:38.914284 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-12cbd7f4-561d-4fca-996b-026c1431936d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Flavor limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:30:38.914716 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-12cbd7f4-561d-4fca-996b-026c1431936d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Image limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:30:38.915248 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-12cbd7f4-561d-4fca-996b-026c1431936d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Flavor pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:30:38.915660 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-12cbd7f4-561d-4fca-996b-026c1431936d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Image pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:30:38.916073 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-12cbd7f4-561d-4fca-996b-026c1431936d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:30:38.928681 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-12cbd7f4-561d-4fca-996b-026c1431936d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:38.929226 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-12cbd7f4-561d-4fca-996b-026c1431936d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:38.930090 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-12cbd7f4-561d-4fca-996b-026c1431936d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:38.930666 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-12cbd7f4-561d-4fca-996b-026c1431936d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:38.949089 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-12cbd7f4-561d-4fca-996b-026c1431936d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Getting quotas for project 9920208c82644be1813c48167d2a9632. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:30:38.953781 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-12cbd7f4-561d-4fca-996b-026c1431936d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Getting quotas for user e7c71bb76fe243f3b2d69a63e42e5a26 and project 9920208c82644be1813c48167d2a9632. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:30:38.968415 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-12cbd7f4-561d-4fca-996b-026c1431936d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Going to run 1 instances... {{(pid=116376) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:30:38.970791 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-12cbd7f4-561d-4fca-996b-026c1431936d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7d259ac-b206-430f-a3c0-794cee408236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116376) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:30:39.034353 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-12cbd7f4-561d-4fca-996b-026c1431936d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612059 Jan 18 20:30:39.035678 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 433/872] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:30:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 18 20:30:39.050428 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-62082c17-4e67-465c-94f4-0e9cf4d4a5ec tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:39.051837 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-62082c17-4e67-465c-94f4-0e9cf4d4a5ec tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:39.126812 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-62082c17-4e67-465c-94f4-0e9cf4d4a5ec tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:39.134240 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-62082c17-4e67-465c-94f4-0e9cf4d4a5ec tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b" status: 200 len: 1214 microversion: 2.1 time: 0.091938 Jan 18 20:30:39.135391 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 440/873] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:39 2022] GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:40.155447 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-1d0586bd-b279-4e83-9874-bcd4d448664b tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:40.156669 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-1d0586bd-b279-4e83-9874-bcd4d448664b tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:40.163797 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1d0586bd-b279-4e83-9874-bcd4d448664b tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:40.164292 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1d0586bd-b279-4e83-9874-bcd4d448664b tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:40.165077 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1d0586bd-b279-4e83-9874-bcd4d448664b tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:40.165510 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1d0586bd-b279-4e83-9874-bcd4d448664b tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:40.254242 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-1d0586bd-b279-4e83-9874-bcd4d448664b tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:40.261626 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-1d0586bd-b279-4e83-9874-bcd4d448664b tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b" status: 200 len: 1284 microversion: 2.1 time: 0.110032 Jan 18 20:30:40.262384 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 434/874] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:40 2022] GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b => generated 1284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:41.279078 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ca546b56-7d99-497d-a9cd-51924118cfcd tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:41.279827 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ca546b56-7d99-497d-a9cd-51924118cfcd tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:41.287333 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca546b56-7d99-497d-a9cd-51924118cfcd tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:41.287790 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca546b56-7d99-497d-a9cd-51924118cfcd tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:41.288589 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca546b56-7d99-497d-a9cd-51924118cfcd tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:41.289036 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca546b56-7d99-497d-a9cd-51924118cfcd tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:41.426647 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ca546b56-7d99-497d-a9cd-51924118cfcd tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:41.434251 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ca546b56-7d99-497d-a9cd-51924118cfcd tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b" status: 200 len: 1314 microversion: 2.1 time: 0.158806 Jan 18 20:30:41.434751 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 441/875] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:41 2022] GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:41.688742 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-ca48ea24-1bce-4808-b43e-5700ec0ffa87 req-3079f109-34af-4cd9-96b4-dd688c6ef3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b", "tag": "b6efd8c2-8a05-4394-99ea-f81d7dbe8640"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:30:41.690320 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:30:41.690320 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:30:41.698214 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-ca48ea24-1bce-4808-b43e-5700ec0ffa87 req-3079f109-34af-4cd9-96b4-dd688c6ef3c2 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:41.698659 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-ca48ea24-1bce-4808-b43e-5700ec0ffa87 req-3079f109-34af-4cd9-96b4-dd688c6ef3c2 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:41.716367 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-ca48ea24-1bce-4808-b43e-5700ec0ffa87 req-3079f109-34af-4cd9-96b4-dd688c6ef3c2 service nova] Creating event network-changed:b6efd8c2-8a05-4394-99ea-f81d7dbe8640 for instance a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b on hv-cinder-82160 Jan 18 20:30:41.721440 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-ca48ea24-1bce-4808-b43e-5700ec0ffa87 req-3079f109-34af-4cd9-96b4-dd688c6ef3c2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037792 Jan 18 20:30:41.722205 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 435/876] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:30:42.453032 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b2fdd27b-88d9-430a-8b11-57284d070b19 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:42.453672 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b2fdd27b-88d9-430a-8b11-57284d070b19 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:42.460501 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b2fdd27b-88d9-430a-8b11-57284d070b19 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:42.460955 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b2fdd27b-88d9-430a-8b11-57284d070b19 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:42.461759 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b2fdd27b-88d9-430a-8b11-57284d070b19 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:42.462528 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b2fdd27b-88d9-430a-8b11-57284d070b19 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:42.702483 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b2fdd27b-88d9-430a-8b11-57284d070b19 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:42.711236 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b2fdd27b-88d9-430a-8b11-57284d070b19 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b" status: 200 len: 1314 microversion: 2.1 time: 0.262316 Jan 18 20:30:42.711817 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 442/877] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:42 2022] GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:43.730227 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a55ab54e-bffc-4768-896d-3d17a063a22e tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:43.731180 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-a55ab54e-bffc-4768-896d-3d17a063a22e tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:43.738704 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a55ab54e-bffc-4768-896d-3d17a063a22e tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:43.739357 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a55ab54e-bffc-4768-896d-3d17a063a22e tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:43.740323 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a55ab54e-bffc-4768-896d-3d17a063a22e tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:43.740883 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a55ab54e-bffc-4768-896d-3d17a063a22e tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:43.914637 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a55ab54e-bffc-4768-896d-3d17a063a22e tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:43.924015 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a55ab54e-bffc-4768-896d-3d17a063a22e tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b" status: 200 len: 1314 microversion: 2.1 time: 0.198622 Jan 18 20:30:43.924810 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 436/878] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:43 2022] GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:44.941722 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1e4ecf53-ff36-460f-a06d-ebe44421558d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:44.942302 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1e4ecf53-ff36-460f-a06d-ebe44421558d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:44.948964 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1e4ecf53-ff36-460f-a06d-ebe44421558d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:44.949407 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1e4ecf53-ff36-460f-a06d-ebe44421558d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:44.950194 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1e4ecf53-ff36-460f-a06d-ebe44421558d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:44.951350 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1e4ecf53-ff36-460f-a06d-ebe44421558d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:45.096421 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1e4ecf53-ff36-460f-a06d-ebe44421558d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:45.104062 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1e4ecf53-ff36-460f-a06d-ebe44421558d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b" status: 200 len: 1314 microversion: 2.1 time: 0.166208 Jan 18 20:30:45.104634 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 443/879] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:44 2022] GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:46.120477 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-efb83a14-cb43-4875-b24f-3aac630286b1 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:46.121355 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-efb83a14-cb43-4875-b24f-3aac630286b1 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:46.128045 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-efb83a14-cb43-4875-b24f-3aac630286b1 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:46.128831 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-efb83a14-cb43-4875-b24f-3aac630286b1 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:46.129503 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-efb83a14-cb43-4875-b24f-3aac630286b1 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:46.130066 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-efb83a14-cb43-4875-b24f-3aac630286b1 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:46.298871 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-efb83a14-cb43-4875-b24f-3aac630286b1 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:46.306815 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-efb83a14-cb43-4875-b24f-3aac630286b1 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b" status: 200 len: 1314 microversion: 2.1 time: 0.190045 Jan 18 20:30:46.319057 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 437/880] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:46 2022] GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:46.356998 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-a163b530-c81e-4bc2-8438-b61fcd0fbbe5 req-c80521ee-25e2-4624-a5cf-1349fa5ba4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b", "name": "network-vif-plugged", "status": "completed", "tag": "b6efd8c2-8a05-4394-99ea-f81d7dbe8640"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:30:46.358608 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:30:46.358608 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:30:46.366765 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-a163b530-c81e-4bc2-8438-b61fcd0fbbe5 req-c80521ee-25e2-4624-a5cf-1349fa5ba4f6 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:46.367233 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-a163b530-c81e-4bc2-8438-b61fcd0fbbe5 req-c80521ee-25e2-4624-a5cf-1349fa5ba4f6 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:46.378781 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-a163b530-c81e-4bc2-8438-b61fcd0fbbe5 req-c80521ee-25e2-4624-a5cf-1349fa5ba4f6 service nova] Creating event network-vif-plugged:b6efd8c2-8a05-4394-99ea-f81d7dbe8640 for instance a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b on hv-cinder-82160 Jan 18 20:30:46.383909 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-a163b530-c81e-4bc2-8438-b61fcd0fbbe5 req-c80521ee-25e2-4624-a5cf-1349fa5ba4f6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030810 Jan 18 20:30:46.384498 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 444/881] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:30:47.328518 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e91e7460-0729-4b84-9ddc-a8a071f7f198 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:47.329124 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e91e7460-0729-4b84-9ddc-a8a071f7f198 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:47.335524 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e91e7460-0729-4b84-9ddc-a8a071f7f198 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:47.335971 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e91e7460-0729-4b84-9ddc-a8a071f7f198 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:47.336748 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e91e7460-0729-4b84-9ddc-a8a071f7f198 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:47.337183 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e91e7460-0729-4b84-9ddc-a8a071f7f198 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:47.463834 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-e91e7460-0729-4b84-9ddc-a8a071f7f198 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:47.471710 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e91e7460-0729-4b84-9ddc-a8a071f7f198 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b" status: 200 len: 1314 microversion: 2.1 time: 0.146823 Jan 18 20:30:47.472278 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 438/882] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:47 2022] GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:48.489414 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9b1abe71-519a-4719-9957-fe26b5ea253a tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:48.490114 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9b1abe71-519a-4719-9957-fe26b5ea253a tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:48.496291 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b1abe71-519a-4719-9957-fe26b5ea253a tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:48.496736 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b1abe71-519a-4719-9957-fe26b5ea253a tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:48.498171 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b1abe71-519a-4719-9957-fe26b5ea253a tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:48.498611 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b1abe71-519a-4719-9957-fe26b5ea253a tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:48.627289 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9b1abe71-519a-4719-9957-fe26b5ea253a tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:48.634563 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9b1abe71-519a-4719-9957-fe26b5ea253a tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b" status: 200 len: 1498 microversion: 2.1 time: 0.149628 Jan 18 20:30:48.635140 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 445/883] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:48 2022] GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:50.887440 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-701de7ad-5054-4b7d-a9cd-b1a53970e00c tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:50.888567 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-701de7ad-5054-4b7d-a9cd-b1a53970e00c tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:50.894111 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-701de7ad-5054-4b7d-a9cd-b1a53970e00c tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:50.894561 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-701de7ad-5054-4b7d-a9cd-b1a53970e00c tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:50.895363 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-701de7ad-5054-4b7d-a9cd-b1a53970e00c tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:50.895799 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-701de7ad-5054-4b7d-a9cd-b1a53970e00c tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:50.923705 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-701de7ad-5054-4b7d-a9cd-b1a53970e00c tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b] Going to try to terminate instance {{(pid=116376) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:30:51.009002 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-701de7ad-5054-4b7d-a9cd-b1a53970e00c tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b" status: 204 len: 0 microversion: 2.1 time: 0.124283 Jan 18 20:30:51.011172 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 439/884] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:30:50 2022] DELETE /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:30:51.019573 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f63e63f3-44aa-484f-a3f6-7e1c448af0cc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:51.020171 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f63e63f3-44aa-484f-a3f6-7e1c448af0cc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:51.026809 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f63e63f3-44aa-484f-a3f6-7e1c448af0cc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:51.027485 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f63e63f3-44aa-484f-a3f6-7e1c448af0cc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:51.028412 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f63e63f3-44aa-484f-a3f6-7e1c448af0cc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:51.029013 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f63e63f3-44aa-484f-a3f6-7e1c448af0cc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:51.164641 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f63e63f3-44aa-484f-a3f6-7e1c448af0cc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:51.174751 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f63e63f3-44aa-484f-a3f6-7e1c448af0cc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b" status: 200 len: 1504 microversion: 2.1 time: 0.159068 Jan 18 20:30:51.175425 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 446/885] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:51 2022] GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:52.192104 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b7bdcaf9-cfe0-436b-8796-38f317aff9c5 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:52.192724 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b7bdcaf9-cfe0-436b-8796-38f317aff9c5 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:52.198953 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b7bdcaf9-cfe0-436b-8796-38f317aff9c5 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:52.199446 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b7bdcaf9-cfe0-436b-8796-38f317aff9c5 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:52.200735 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b7bdcaf9-cfe0-436b-8796-38f317aff9c5 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:52.201180 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b7bdcaf9-cfe0-436b-8796-38f317aff9c5 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:52.344102 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b7bdcaf9-cfe0-436b-8796-38f317aff9c5 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:52.351742 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b7bdcaf9-cfe0-436b-8796-38f317aff9c5 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b" status: 200 len: 1504 microversion: 2.1 time: 0.163617 Jan 18 20:30:52.352324 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 440/886] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:52 2022] GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:53.369125 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a32fb459-76ca-4ca7-bcb2-4ad6066bde1b tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:53.369666 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a32fb459-76ca-4ca7-bcb2-4ad6066bde1b tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:53.375816 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a32fb459-76ca-4ca7-bcb2-4ad6066bde1b tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:53.376271 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a32fb459-76ca-4ca7-bcb2-4ad6066bde1b tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:53.377051 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a32fb459-76ca-4ca7-bcb2-4ad6066bde1b tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:53.377492 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a32fb459-76ca-4ca7-bcb2-4ad6066bde1b tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:53.505398 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a32fb459-76ca-4ca7-bcb2-4ad6066bde1b tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:53.512633 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a32fb459-76ca-4ca7-bcb2-4ad6066bde1b tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b" status: 200 len: 1504 microversion: 2.1 time: 0.147321 Jan 18 20:30:53.513194 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 447/887] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:53 2022] GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:54.529456 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-2265337e-7d7f-40f2-a7fb-17b02b71fb77 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:54.530069 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-2265337e-7d7f-40f2-a7fb-17b02b71fb77 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:54.536501 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2265337e-7d7f-40f2-a7fb-17b02b71fb77 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:54.536957 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2265337e-7d7f-40f2-a7fb-17b02b71fb77 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:54.537739 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2265337e-7d7f-40f2-a7fb-17b02b71fb77 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:54.538179 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2265337e-7d7f-40f2-a7fb-17b02b71fb77 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:54.769622 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-2265337e-7d7f-40f2-a7fb-17b02b71fb77 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:54.776935 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2265337e-7d7f-40f2-a7fb-17b02b71fb77 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b" status: 200 len: 1504 microversion: 2.1 time: 0.251155 Jan 18 20:30:54.777514 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 441/888] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:54 2022] GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b => generated 1504 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:54.933236 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-d8c9b562-060a-4be2-bdf5-0b31eaab999b req-7cd79d68-43aa-4c2c-acfd-7ee5bdc80116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b", "name": "network-vif-deleted", "tag": "b6efd8c2-8a05-4394-99ea-f81d7dbe8640"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:30:54.934804 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:30:54.934804 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:30:54.943406 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-d8c9b562-060a-4be2-bdf5-0b31eaab999b req-7cd79d68-43aa-4c2c-acfd-7ee5bdc80116 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:54.943880 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-d8c9b562-060a-4be2-bdf5-0b31eaab999b req-7cd79d68-43aa-4c2c-acfd-7ee5bdc80116 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:54.955714 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-d8c9b562-060a-4be2-bdf5-0b31eaab999b req-7cd79d68-43aa-4c2c-acfd-7ee5bdc80116 service nova] Creating event network-vif-deleted:b6efd8c2-8a05-4394-99ea-f81d7dbe8640 for instance a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b on hv-cinder-82160 Jan 18 20:30:54.962412 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-d8c9b562-060a-4be2-bdf5-0b31eaab999b req-7cd79d68-43aa-4c2c-acfd-7ee5bdc80116 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032955 Jan 18 20:30:54.962999 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 448/889] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:30:55.794886 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4a743732-4cef-45f9-93cb-495009040563 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:55.795795 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-4a743732-4cef-45f9-93cb-495009040563 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:55.802083 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4a743732-4cef-45f9-93cb-495009040563 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:55.802533 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4a743732-4cef-45f9-93cb-495009040563 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:55.803453 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4a743732-4cef-45f9-93cb-495009040563 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:55.803795 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4a743732-4cef-45f9-93cb-495009040563 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:55.816577 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-4a743732-4cef-45f9-93cb-495009040563 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] HTTP exception thrown: Instance a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b could not be found. Jan 18 20:30:55.817339 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4a743732-4cef-45f9-93cb-495009040563 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Returning 404 to user: Instance a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:30:55.818093 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-4a743732-4cef-45f9-93cb-495009040563 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b" status: 404 len: 111 microversion: 2.1 time: 0.026784 Jan 18 20:30:55.818619 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 442/890] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:55 2022] GET /compute/v2.1/servers/a8d25cb8-af1a-4c05-9c7d-6016f7bb9a8b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:30:55.910309 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3dd255d0-0484-4acb-8dae-793dd6f873fc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-991601828", "imageRef": "c7d259ac-b206-430f-a3c0-794cee408236", "flavorRef": "452", "networks": [{"uuid": "6a078bd6-d1cf-4974-abca-9ca9f02026e1"}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:30:55.963967 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-3dd255d0-0484-4acb-8dae-793dd6f873fc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] validate_networks() for [('6a078bd6-d1cf-4974-abca-9ca9f02026e1', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:30:56.299816 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-3dd255d0-0484-4acb-8dae-793dd6f873fc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:30:56.300232 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-3dd255d0-0484-4acb-8dae-793dd6f873fc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:30:56.300700 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-3dd255d0-0484-4acb-8dae-793dd6f873fc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:30:56.301097 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-3dd255d0-0484-4acb-8dae-793dd6f873fc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:30:56.301638 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-3dd255d0-0484-4acb-8dae-793dd6f873fc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:30:56.311138 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3dd255d0-0484-4acb-8dae-793dd6f873fc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:56.311607 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3dd255d0-0484-4acb-8dae-793dd6f873fc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:56.312596 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3dd255d0-0484-4acb-8dae-793dd6f873fc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:56.313025 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3dd255d0-0484-4acb-8dae-793dd6f873fc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:56.328940 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-3dd255d0-0484-4acb-8dae-793dd6f873fc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Getting quotas for project 9920208c82644be1813c48167d2a9632. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:30:56.333233 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-3dd255d0-0484-4acb-8dae-793dd6f873fc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Getting quotas for user e7c71bb76fe243f3b2d69a63e42e5a26 and project 9920208c82644be1813c48167d2a9632. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:30:56.344497 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3dd255d0-0484-4acb-8dae-793dd6f873fc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:30:56.346930 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3dd255d0-0484-4acb-8dae-793dd6f873fc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7d259ac-b206-430f-a3c0-794cee408236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:30:56.391887 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3dd255d0-0484-4acb-8dae-793dd6f873fc tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485552 Jan 18 20:30:56.392693 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 449/891] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:30:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 20:30:56.402051 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-c6eb57f8-a0ff-49c5-b53a-d1c7b7be069f tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:56.402669 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-c6eb57f8-a0ff-49c5-b53a-d1c7b7be069f tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:56.456348 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-c6eb57f8-a0ff-49c5-b53a-d1c7b7be069f tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:56.463147 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-c6eb57f8-a0ff-49c5-b53a-d1c7b7be069f tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf" status: 200 len: 1213 microversion: 2.1 time: 0.064514 Jan 18 20:30:56.463589 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 443/892] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:56 2022] GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:57.481024 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6168d3c1-8b41-497c-93e3-425580917551 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:57.482001 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6168d3c1-8b41-497c-93e3-425580917551 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:57.490123 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6168d3c1-8b41-497c-93e3-425580917551 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:57.490646 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6168d3c1-8b41-497c-93e3-425580917551 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:57.491537 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6168d3c1-8b41-497c-93e3-425580917551 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:57.492044 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6168d3c1-8b41-497c-93e3-425580917551 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:57.557274 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6168d3c1-8b41-497c-93e3-425580917551 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:57.565248 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6168d3c1-8b41-497c-93e3-425580917551 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf" status: 200 len: 1271 microversion: 2.1 time: 0.088387 Jan 18 20:30:57.575224 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 450/893] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:57 2022] GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:58.582688 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-88dedf46-33af-4a10-aa80-8e1d4f272a81 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:58.583499 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-88dedf46-33af-4a10-aa80-8e1d4f272a81 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:58.592169 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-88dedf46-33af-4a10-aa80-8e1d4f272a81 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:58.592940 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-88dedf46-33af-4a10-aa80-8e1d4f272a81 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:58.593767 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-88dedf46-33af-4a10-aa80-8e1d4f272a81 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:58.594212 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-88dedf46-33af-4a10-aa80-8e1d4f272a81 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:58.632602 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-6e75dc7d-862b-433f-99b2-2dabb1146118 req-80eb4edd-b57e-4937-9277-68aaa803a8fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13bde3d0-9c19-4189-86c7-f0674b7b3bdf", "tag": "203db2ec-6cc6-40ce-b025-13fd871e7969"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:30:58.634354 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:30:58.634354 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:30:58.642174 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-6e75dc7d-862b-433f-99b2-2dabb1146118 req-80eb4edd-b57e-4937-9277-68aaa803a8fe service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:58.642622 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-6e75dc7d-862b-433f-99b2-2dabb1146118 req-80eb4edd-b57e-4937-9277-68aaa803a8fe service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:58.654989 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-6e75dc7d-862b-433f-99b2-2dabb1146118 req-80eb4edd-b57e-4937-9277-68aaa803a8fe service nova] Creating event network-changed:203db2ec-6cc6-40ce-b025-13fd871e7969 for instance 13bde3d0-9c19-4189-86c7-f0674b7b3bdf on hv-cinder-82160 Jan 18 20:30:58.659910 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-6e75dc7d-862b-433f-99b2-2dabb1146118 req-80eb4edd-b57e-4937-9277-68aaa803a8fe service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031170 Jan 18 20:30:58.660498 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 451/894] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:30:58.754886 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-88dedf46-33af-4a10-aa80-8e1d4f272a81 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:58.762164 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-88dedf46-33af-4a10-aa80-8e1d4f272a81 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf" status: 200 len: 1313 microversion: 2.1 time: 0.183692 Jan 18 20:30:58.762958 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 444/895] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:58 2022] GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:30:59.779517 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-697852e9-73a5-4aac-ba3c-5c1095773bd0 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:30:59.780257 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-697852e9-73a5-4aac-ba3c-5c1095773bd0 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:30:59.787895 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-697852e9-73a5-4aac-ba3c-5c1095773bd0 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:59.788354 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-697852e9-73a5-4aac-ba3c-5c1095773bd0 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:59.789174 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-697852e9-73a5-4aac-ba3c-5c1095773bd0 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:30:59.789658 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-697852e9-73a5-4aac-ba3c-5c1095773bd0 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:30:59.941354 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-697852e9-73a5-4aac-ba3c-5c1095773bd0 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:30:59.948989 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-697852e9-73a5-4aac-ba3c-5c1095773bd0 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf" status: 200 len: 1313 microversion: 2.1 time: 0.174433 Jan 18 20:30:59.949597 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 452/896] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:30:59 2022] GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:00.969412 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-2d806c6a-c0ed-47b3-b686-33ef63ec57f0 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:00.970019 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-2d806c6a-c0ed-47b3-b686-33ef63ec57f0 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:00.976494 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2d806c6a-c0ed-47b3-b686-33ef63ec57f0 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:00.977181 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2d806c6a-c0ed-47b3-b686-33ef63ec57f0 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:00.977986 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2d806c6a-c0ed-47b3-b686-33ef63ec57f0 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:00.978427 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2d806c6a-c0ed-47b3-b686-33ef63ec57f0 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:01.154187 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-2d806c6a-c0ed-47b3-b686-33ef63ec57f0 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:01.162161 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2d806c6a-c0ed-47b3-b686-33ef63ec57f0 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf" status: 200 len: 1313 microversion: 2.1 time: 0.197346 Jan 18 20:31:01.162746 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 445/897] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:00 2022] GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:02.179710 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f28317da-700c-4fcd-b2c4-ec5a3fb67553 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:02.180257 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f28317da-700c-4fcd-b2c4-ec5a3fb67553 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:02.186676 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f28317da-700c-4fcd-b2c4-ec5a3fb67553 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:02.187159 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f28317da-700c-4fcd-b2c4-ec5a3fb67553 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:02.187953 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f28317da-700c-4fcd-b2c4-ec5a3fb67553 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:02.188385 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f28317da-700c-4fcd-b2c4-ec5a3fb67553 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:02.329623 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f28317da-700c-4fcd-b2c4-ec5a3fb67553 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:02.337869 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f28317da-700c-4fcd-b2c4-ec5a3fb67553 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf" status: 200 len: 1313 microversion: 2.1 time: 0.161932 Jan 18 20:31:02.338563 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 453/898] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:02 2022] GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:03.355596 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-45f465ed-2def-48ee-af90-810c1ce752b3 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:03.356191 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-45f465ed-2def-48ee-af90-810c1ce752b3 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:03.363194 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-45f465ed-2def-48ee-af90-810c1ce752b3 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:03.363664 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-45f465ed-2def-48ee-af90-810c1ce752b3 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:03.364494 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-45f465ed-2def-48ee-af90-810c1ce752b3 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:03.364933 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-45f465ed-2def-48ee-af90-810c1ce752b3 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:03.770951 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-45f465ed-2def-48ee-af90-810c1ce752b3 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:03.779581 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-45f465ed-2def-48ee-af90-810c1ce752b3 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf" status: 200 len: 1313 microversion: 2.1 time: 0.426901 Jan 18 20:31:03.780422 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 446/899] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:03 2022] GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:04.797155 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c381aaa6-d241-47e0-96e9-f4b3f3fa9311 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:04.797841 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c381aaa6-d241-47e0-96e9-f4b3f3fa9311 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:04.805101 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c381aaa6-d241-47e0-96e9-f4b3f3fa9311 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:04.805552 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c381aaa6-d241-47e0-96e9-f4b3f3fa9311 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:04.806443 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c381aaa6-d241-47e0-96e9-f4b3f3fa9311 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:04.806899 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c381aaa6-d241-47e0-96e9-f4b3f3fa9311 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:04.957338 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c381aaa6-d241-47e0-96e9-f4b3f3fa9311 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:04.968390 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c381aaa6-d241-47e0-96e9-f4b3f3fa9311 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf" status: 200 len: 1313 microversion: 2.1 time: 0.175095 Jan 18 20:31:04.968969 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 454/900] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:04 2022] GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:05.986610 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-907beece-3a12-4919-9e6d-921b40ff7916 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:05.986610 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-907beece-3a12-4919-9e6d-921b40ff7916 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:05.993772 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-907beece-3a12-4919-9e6d-921b40ff7916 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:05.994209 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-907beece-3a12-4919-9e6d-921b40ff7916 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:05.995018 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-907beece-3a12-4919-9e6d-921b40ff7916 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:05.995912 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-907beece-3a12-4919-9e6d-921b40ff7916 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:06.160068 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-907beece-3a12-4919-9e6d-921b40ff7916 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:06.168574 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-907beece-3a12-4919-9e6d-921b40ff7916 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf" status: 200 len: 1313 microversion: 2.1 time: 0.187193 Jan 18 20:31:06.169189 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 447/901] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:05 2022] GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:06.815747 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-e91ed782-9d6f-4dcd-a15c-f02f112941d4 req-e168c858-f1fb-413a-ac67-ee55aae5030d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13bde3d0-9c19-4189-86c7-f0674b7b3bdf", "name": "network-vif-plugged", "status": "completed", "tag": "203db2ec-6cc6-40ce-b025-13fd871e7969"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:31:06.817373 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:31:06.817373 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:31:06.825190 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-e91ed782-9d6f-4dcd-a15c-f02f112941d4 req-e168c858-f1fb-413a-ac67-ee55aae5030d service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:06.826295 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-e91ed782-9d6f-4dcd-a15c-f02f112941d4 req-e168c858-f1fb-413a-ac67-ee55aae5030d service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:06.838469 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-e91ed782-9d6f-4dcd-a15c-f02f112941d4 req-e168c858-f1fb-413a-ac67-ee55aae5030d service nova] Creating event network-vif-plugged:203db2ec-6cc6-40ce-b025-13fd871e7969 for instance 13bde3d0-9c19-4189-86c7-f0674b7b3bdf on hv-cinder-82160 Jan 18 20:31:06.843752 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-e91ed782-9d6f-4dcd-a15c-f02f112941d4 req-e168c858-f1fb-413a-ac67-ee55aae5030d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031563 Jan 18 20:31:06.844311 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 455/902] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:31:07.186173 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-27ed768d-f79c-4773-8f6e-eb46cdda52ae tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:07.186712 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-27ed768d-f79c-4773-8f6e-eb46cdda52ae tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:07.193744 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-27ed768d-f79c-4773-8f6e-eb46cdda52ae tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:07.194191 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-27ed768d-f79c-4773-8f6e-eb46cdda52ae tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:07.194990 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-27ed768d-f79c-4773-8f6e-eb46cdda52ae tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:07.195475 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-27ed768d-f79c-4773-8f6e-eb46cdda52ae tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:07.334792 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-27ed768d-f79c-4773-8f6e-eb46cdda52ae tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:07.342263 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-27ed768d-f79c-4773-8f6e-eb46cdda52ae tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf" status: 200 len: 1313 microversion: 2.1 time: 0.160450 Jan 18 20:31:07.342837 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 448/903] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:07 2022] GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:08.362611 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-cf459b7b-27af-463e-88f6-ca8793fbfa0d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:08.363428 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-cf459b7b-27af-463e-88f6-ca8793fbfa0d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:08.370028 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cf459b7b-27af-463e-88f6-ca8793fbfa0d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:08.370473 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cf459b7b-27af-463e-88f6-ca8793fbfa0d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:08.371281 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cf459b7b-27af-463e-88f6-ca8793fbfa0d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:08.371720 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cf459b7b-27af-463e-88f6-ca8793fbfa0d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:08.521362 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-cf459b7b-27af-463e-88f6-ca8793fbfa0d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:08.529676 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-cf459b7b-27af-463e-88f6-ca8793fbfa0d tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf" status: 200 len: 1496 microversion: 2.1 time: 0.170799 Jan 18 20:31:08.530714 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 456/904] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:08 2022] GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf => generated 1496 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:08.986514 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-481c7b74-292a-4cfe-bd13-861b8586f94f tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:08.987011 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-481c7b74-292a-4cfe-bd13-861b8586f94f tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:08.993409 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-481c7b74-292a-4cfe-bd13-861b8586f94f tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:08.993858 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-481c7b74-292a-4cfe-bd13-861b8586f94f tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:08.994632 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-481c7b74-292a-4cfe-bd13-861b8586f94f tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:08.995086 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-481c7b74-292a-4cfe-bd13-861b8586f94f tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:09.019937 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-481c7b74-292a-4cfe-bd13-861b8586f94f tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] Going to try to terminate instance {{(pid=116376) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:31:09.094543 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-481c7b74-292a-4cfe-bd13-861b8586f94f tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "DELETE /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf" status: 204 len: 0 microversion: 2.1 time: 0.112118 Jan 18 20:31:09.095306 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 449/905] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:31:08 2022] DELETE /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:31:09.103960 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-80036c70-5e7e-4194-a074-7383c1b13e79 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:09.104563 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-80036c70-5e7e-4194-a074-7383c1b13e79 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:09.111130 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-80036c70-5e7e-4194-a074-7383c1b13e79 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:09.111572 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-80036c70-5e7e-4194-a074-7383c1b13e79 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:09.112339 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-80036c70-5e7e-4194-a074-7383c1b13e79 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:09.112772 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-80036c70-5e7e-4194-a074-7383c1b13e79 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:09.240516 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-80036c70-5e7e-4194-a074-7383c1b13e79 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:09.248614 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-80036c70-5e7e-4194-a074-7383c1b13e79 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf" status: 200 len: 1502 microversion: 2.1 time: 0.148190 Jan 18 20:31:09.249182 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 457/906] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:09 2022] GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf => generated 1502 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:10.266441 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-3842def4-79f2-4262-95f9-5951bd8b628e tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:10.267080 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-3842def4-79f2-4262-95f9-5951bd8b628e tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:10.273361 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3842def4-79f2-4262-95f9-5951bd8b628e tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:10.273812 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3842def4-79f2-4262-95f9-5951bd8b628e tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:10.274593 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3842def4-79f2-4262-95f9-5951bd8b628e tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:10.275061 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3842def4-79f2-4262-95f9-5951bd8b628e tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:10.410426 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-3842def4-79f2-4262-95f9-5951bd8b628e tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:10.417742 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-3842def4-79f2-4262-95f9-5951bd8b628e tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf" status: 200 len: 1502 microversion: 2.1 time: 0.155477 Jan 18 20:31:10.418306 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 450/907] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:10 2022] GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:11.070539 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-7217b349-92fe-4df4-94bf-46071358143b req-f902e569-ce88-418a-8f49-2456e3a7ff2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13bde3d0-9c19-4189-86c7-f0674b7b3bdf", "name": "network-vif-deleted", "tag": "203db2ec-6cc6-40ce-b025-13fd871e7969"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:31:11.072198 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:31:11.072198 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:31:11.081105 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-7217b349-92fe-4df4-94bf-46071358143b req-f902e569-ce88-418a-8f49-2456e3a7ff2d service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:11.081544 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-7217b349-92fe-4df4-94bf-46071358143b req-f902e569-ce88-418a-8f49-2456e3a7ff2d service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:11.096076 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-7217b349-92fe-4df4-94bf-46071358143b req-f902e569-ce88-418a-8f49-2456e3a7ff2d service nova] Creating event network-vif-deleted:203db2ec-6cc6-40ce-b025-13fd871e7969 for instance 13bde3d0-9c19-4189-86c7-f0674b7b3bdf on hv-cinder-82160 Jan 18 20:31:11.101890 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-7217b349-92fe-4df4-94bf-46071358143b req-f902e569-ce88-418a-8f49-2456e3a7ff2d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034899 Jan 18 20:31:11.102792 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 458/908] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:31:11.436775 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b09b8493-c57c-4349-b3a5-39cf1fcbb8e9 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:11.437411 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b09b8493-c57c-4349-b3a5-39cf1fcbb8e9 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:11.443845 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b09b8493-c57c-4349-b3a5-39cf1fcbb8e9 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:11.444299 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b09b8493-c57c-4349-b3a5-39cf1fcbb8e9 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:11.445094 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b09b8493-c57c-4349-b3a5-39cf1fcbb8e9 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:11.445534 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b09b8493-c57c-4349-b3a5-39cf1fcbb8e9 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:11.478490 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b09b8493-c57c-4349-b3a5-39cf1fcbb8e9 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:11.478944 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b09b8493-c57c-4349-b3a5-39cf1fcbb8e9 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:11.479424 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.objects.instance [None req-b09b8493-c57c-4349-b3a5-39cf1fcbb8e9 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lazy-loading 'fault' on Instance uuid 13bde3d0-9c19-4189-86c7-f0674b7b3bdf {{(pid=116376) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:31:11.518365 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b09b8493-c57c-4349-b3a5-39cf1fcbb8e9 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c71bb76fe243f3b2d69a63e42e5a26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9920208c82644be1813c48167d2a9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:11.526701 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b09b8493-c57c-4349-b3a5-39cf1fcbb8e9 tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf" status: 200 len: 1303 microversion: 2.1 time: 0.094953 Jan 18 20:31:11.527543 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 451/909] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:11 2022] GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:12.544128 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2f723681-c689-43eb-9fdb-e726d255514c tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:12.545085 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2f723681-c689-43eb-9fdb-e726d255514c tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] [instance: 13bde3d0-9c19-4189-86c7-f0674b7b3bdf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:12.551885 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2f723681-c689-43eb-9fdb-e726d255514c tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:12.552332 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2f723681-c689-43eb-9fdb-e726d255514c tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:12.554177 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2f723681-c689-43eb-9fdb-e726d255514c tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:12.554650 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2f723681-c689-43eb-9fdb-e726d255514c tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:12.568874 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-2f723681-c689-43eb-9fdb-e726d255514c tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] HTTP exception thrown: Instance 13bde3d0-9c19-4189-86c7-f0674b7b3bdf could not be found. Jan 18 20:31:12.569463 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2f723681-c689-43eb-9fdb-e726d255514c tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] Returning 404 to user: Instance 13bde3d0-9c19-4189-86c7-f0674b7b3bdf could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:31:12.570282 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2f723681-c689-43eb-9fdb-e726d255514c tempest-VolumesActionsTest-614646747 tempest-VolumesActionsTest-614646747-project] 10.222.0.67 "GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf" status: 404 len: 111 microversion: 2.1 time: 0.030193 Jan 18 20:31:12.570824 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 459/910] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:12 2022] GET /compute/v2.1/servers/13bde3d0-9c19-4189-86c7-f0674b7b3bdf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:31:36.206780 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-e39d968a-b63b-470c-ac94-fe2f0bf51625 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1277477485", "imageRef": "c7d259ac-b206-430f-a3c0-794cee408236", "flavorRef": "452"}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:31:36.264285 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.network.neutron [None req-e39d968a-b63b-470c-ac94-fe2f0bf51625 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] validate_networks() for None {{(pid=116376) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:31:36.661815 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-e39d968a-b63b-470c-ac94-fe2f0bf51625 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Flavor limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:31:36.662242 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-e39d968a-b63b-470c-ac94-fe2f0bf51625 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Image limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:31:36.662934 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-e39d968a-b63b-470c-ac94-fe2f0bf51625 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Flavor pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:31:36.663378 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-e39d968a-b63b-470c-ac94-fe2f0bf51625 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Image pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:31:36.663844 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-e39d968a-b63b-470c-ac94-fe2f0bf51625 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:31:36.676225 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e39d968a-b63b-470c-ac94-fe2f0bf51625 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:36.676690 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e39d968a-b63b-470c-ac94-fe2f0bf51625 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:36.677649 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e39d968a-b63b-470c-ac94-fe2f0bf51625 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:36.678091 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-e39d968a-b63b-470c-ac94-fe2f0bf51625 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:36.696425 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-e39d968a-b63b-470c-ac94-fe2f0bf51625 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Getting quotas for project e2bde4aab26f4d339e0155939ed0fa83. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:31:36.700949 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-e39d968a-b63b-470c-ac94-fe2f0bf51625 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Getting quotas for user 874098ef47304478851102ffe5c43a4c and project e2bde4aab26f4d339e0155939ed0fa83. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:31:36.718076 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e39d968a-b63b-470c-ac94-fe2f0bf51625 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Going to run 1 instances... {{(pid=116376) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:31:36.721404 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-e39d968a-b63b-470c-ac94-fe2f0bf51625 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] [instance: b4d3d018-f50c-46c2-9f7b-3780ac4904a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7d259ac-b206-430f-a3c0-794cee408236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116376) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:31:36.768370 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-e39d968a-b63b-470c-ac94-fe2f0bf51625 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565945 Jan 18 20:31:36.774493 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 452/911] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:31:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 18 20:31:36.779797 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0a447152-4ba2-4604-8319-16892b43d9a9 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:36.780482 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0a447152-4ba2-4604-8319-16892b43d9a9 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] [instance: b4d3d018-f50c-46c2-9f7b-3780ac4904a2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:36.865036 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0a447152-4ba2-4604-8319-16892b43d9a9 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '874098ef47304478851102ffe5c43a4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bde4aab26f4d339e0155939ed0fa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:36.873541 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0a447152-4ba2-4604-8319-16892b43d9a9 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] 10.222.0.67 "GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2" status: 200 len: 1215 microversion: 2.1 time: 0.097550 Jan 18 20:31:36.874280 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 460/912] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:36 2022] GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:37.890453 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-1a13b584-b77a-48c2-b297-47785ba3b13e tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:37.891712 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-1a13b584-b77a-48c2-b297-47785ba3b13e tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] [instance: b4d3d018-f50c-46c2-9f7b-3780ac4904a2] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:37.898129 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1a13b584-b77a-48c2-b297-47785ba3b13e tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:37.898947 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1a13b584-b77a-48c2-b297-47785ba3b13e tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:37.899977 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1a13b584-b77a-48c2-b297-47785ba3b13e tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:37.900525 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1a13b584-b77a-48c2-b297-47785ba3b13e tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:37.989287 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-1a13b584-b77a-48c2-b297-47785ba3b13e tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '874098ef47304478851102ffe5c43a4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bde4aab26f4d339e0155939ed0fa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:37.997571 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-1a13b584-b77a-48c2-b297-47785ba3b13e tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] 10.222.0.67 "GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2" status: 200 len: 1273 microversion: 2.1 time: 0.110907 Jan 18 20:31:37.998142 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 453/913] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:37 2022] GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2 => generated 1273 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:31:38.634960 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b0df3bd6-ba49-4d61-90c0-53acdffb0055 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1486102471", "imageRef": "c7d259ac-b206-430f-a3c0-794cee408236", "flavorRef": "452", "networks": [{"uuid": "5fa84a7d-ab69-4171-8e99-f31488e1981b"}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:31:38.691641 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-b0df3bd6-ba49-4d61-90c0-53acdffb0055 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] validate_networks() for [('5fa84a7d-ab69-4171-8e99-f31488e1981b', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:31:39.017595 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5b0c6c9b-e440-40a4-8063-6a2e6d47d88b tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:39.018361 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-5b0c6c9b-e440-40a4-8063-6a2e6d47d88b tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] [instance: b4d3d018-f50c-46c2-9f7b-3780ac4904a2] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:39.026336 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5b0c6c9b-e440-40a4-8063-6a2e6d47d88b tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:39.026832 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5b0c6c9b-e440-40a4-8063-6a2e6d47d88b tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:39.027944 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5b0c6c9b-e440-40a4-8063-6a2e6d47d88b tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:39.028392 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5b0c6c9b-e440-40a4-8063-6a2e6d47d88b tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:39.311070 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-5b0c6c9b-e440-40a4-8063-6a2e6d47d88b tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '874098ef47304478851102ffe5c43a4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bde4aab26f4d339e0155939ed0fa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:39.319173 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-5b0c6c9b-e440-40a4-8063-6a2e6d47d88b tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] 10.222.0.67 "GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2" status: 200 len: 1315 microversion: 2.1 time: 0.306482 Jan 18 20:31:39.319993 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 454/914] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:39 2022] GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:39.326147 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-b0df3bd6-ba49-4d61-90c0-53acdffb0055 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:31:39.326801 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-b0df3bd6-ba49-4d61-90c0-53acdffb0055 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:31:39.327682 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-b0df3bd6-ba49-4d61-90c0-53acdffb0055 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:31:39.328697 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-b0df3bd6-ba49-4d61-90c0-53acdffb0055 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:31:39.329775 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-b0df3bd6-ba49-4d61-90c0-53acdffb0055 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:31:39.337894 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 20:31:39.338079 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: Tue Jan 18 20:31:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 20:31:39.341350 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0df3bd6-ba49-4d61-90c0-53acdffb0055 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:39.341796 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0df3bd6-ba49-4d61-90c0-53acdffb0055 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:39.342795 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0df3bd6-ba49-4d61-90c0-53acdffb0055 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:39.343270 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0df3bd6-ba49-4d61-90c0-53acdffb0055 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:39.362299 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-b0df3bd6-ba49-4d61-90c0-53acdffb0055 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Getting quotas for project ef9b07bad78a4451b8fa6743f58e1283. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:31:39.366259 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-b0df3bd6-ba49-4d61-90c0-53acdffb0055 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Getting quotas for user 54956be36a9d4739bb2f4f72fdd2baec and project ef9b07bad78a4451b8fa6743f58e1283. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:31:39.380286 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b0df3bd6-ba49-4d61-90c0-53acdffb0055 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:31:39.382639 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b0df3bd6-ba49-4d61-90c0-53acdffb0055 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7d259ac-b206-430f-a3c0-794cee408236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:31:39.393307 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-6f8de077-7da8-4ac8-b4fa-73df7fde90f1 req-29bee213-3f94-447f-8d8e-c35082cbd098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4d3d018-f50c-46c2-9f7b-3780ac4904a2", "tag": "27ca9375-ea8a-4f0e-a61a-83bf6c2eb1cb"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:31:39.395057 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:31:39.395057 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:31:39.410717 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-6f8de077-7da8-4ac8-b4fa-73df7fde90f1 req-29bee213-3f94-447f-8d8e-c35082cbd098 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:39.411192 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-6f8de077-7da8-4ac8-b4fa-73df7fde90f1 req-29bee213-3f94-447f-8d8e-c35082cbd098 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:39.431373 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-6f8de077-7da8-4ac8-b4fa-73df7fde90f1 req-29bee213-3f94-447f-8d8e-c35082cbd098 service nova] Creating event network-changed:27ca9375-ea8a-4f0e-a61a-83bf6c2eb1cb for instance b4d3d018-f50c-46c2-9f7b-3780ac4904a2 on hv-cinder-82160 Jan 18 20:31:39.439348 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-6f8de077-7da8-4ac8-b4fa-73df7fde90f1 req-29bee213-3f94-447f-8d8e-c35082cbd098 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048104 Jan 18 20:31:39.440709 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 455/915] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:31:39.455473 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b0df3bd6-ba49-4d61-90c0-53acdffb0055 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823995 Jan 18 20:31:39.456274 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 461/916] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:31:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 20:31:39.476604 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-80cd455d-b974-449d-b9c1-c602a7d64793 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:39.477739 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-80cd455d-b974-449d-b9c1-c602a7d64793 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:39.589776 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-80cd455d-b974-449d-b9c1-c602a7d64793 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:39.596596 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-80cd455d-b974-449d-b9c1-c602a7d64793 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03" status: 200 len: 1219 microversion: 2.1 time: 0.129670 Jan 18 20:31:39.597530 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 456/917] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:39 2022] GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03 => generated 1219 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:31:40.336392 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-de1d91ff-241d-4db5-be99-b2bee996c29c tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:40.337047 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-de1d91ff-241d-4db5-be99-b2bee996c29c tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] [instance: b4d3d018-f50c-46c2-9f7b-3780ac4904a2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:40.350722 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-de1d91ff-241d-4db5-be99-b2bee996c29c tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:40.351536 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-de1d91ff-241d-4db5-be99-b2bee996c29c tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:40.352886 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-de1d91ff-241d-4db5-be99-b2bee996c29c tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:40.353537 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-de1d91ff-241d-4db5-be99-b2bee996c29c tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:40.539151 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-de1d91ff-241d-4db5-be99-b2bee996c29c tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '874098ef47304478851102ffe5c43a4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bde4aab26f4d339e0155939ed0fa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:40.547112 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-de1d91ff-241d-4db5-be99-b2bee996c29c tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] 10.222.0.67 "GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2" status: 200 len: 1315 microversion: 2.1 time: 0.214416 Jan 18 20:31:40.547692 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 462/918] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:40 2022] GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:40.617268 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-71964651-edc4-4345-bc0a-f4a7ecf07f9d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:40.617899 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-71964651-edc4-4345-bc0a-f4a7ecf07f9d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:40.625295 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-71964651-edc4-4345-bc0a-f4a7ecf07f9d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:40.625736 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-71964651-edc4-4345-bc0a-f4a7ecf07f9d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:40.627299 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-71964651-edc4-4345-bc0a-f4a7ecf07f9d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:40.627904 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-71964651-edc4-4345-bc0a-f4a7ecf07f9d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:40.715460 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-71964651-edc4-4345-bc0a-f4a7ecf07f9d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:40.723197 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-71964651-edc4-4345-bc0a-f4a7ecf07f9d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03" status: 200 len: 1277 microversion: 2.1 time: 0.111077 Jan 18 20:31:40.723772 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 457/919] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:40 2022] GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03 => generated 1277 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:41.568030 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-40e4b5e7-0114-4fcd-a218-008da8003bf6 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:41.569503 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-40e4b5e7-0114-4fcd-a218-008da8003bf6 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] [instance: b4d3d018-f50c-46c2-9f7b-3780ac4904a2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:41.576298 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-40e4b5e7-0114-4fcd-a218-008da8003bf6 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:41.576741 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-40e4b5e7-0114-4fcd-a218-008da8003bf6 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:41.577899 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-40e4b5e7-0114-4fcd-a218-008da8003bf6 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:41.578419 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-40e4b5e7-0114-4fcd-a218-008da8003bf6 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:41.724801 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-40e4b5e7-0114-4fcd-a218-008da8003bf6 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '874098ef47304478851102ffe5c43a4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bde4aab26f4d339e0155939ed0fa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:41.732812 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-40e4b5e7-0114-4fcd-a218-008da8003bf6 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] 10.222.0.67 "GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2" status: 200 len: 1315 microversion: 2.1 time: 0.171192 Jan 18 20:31:41.733397 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 463/920] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:41 2022] GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:41.746883 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-3ed75d4e-8f82-4330-bec7-e968d87a9dac tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:41.748066 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-3ed75d4e-8f82-4330-bec7-e968d87a9dac tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:41.759006 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3ed75d4e-8f82-4330-bec7-e968d87a9dac tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:41.759873 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3ed75d4e-8f82-4330-bec7-e968d87a9dac tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:41.761338 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3ed75d4e-8f82-4330-bec7-e968d87a9dac tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:41.762180 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3ed75d4e-8f82-4330-bec7-e968d87a9dac tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:41.998570 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-3ed75d4e-8f82-4330-bec7-e968d87a9dac tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:42.006532 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-3ed75d4e-8f82-4330-bec7-e968d87a9dac tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03" status: 200 len: 1319 microversion: 2.1 time: 0.268159 Jan 18 20:31:42.007263 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 458/921] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:41 2022] GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:42.158509 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-c13ee1ff-92d7-4bcb-8a6b-b4e2eb7ccdc8 req-bb0ea144-6b90-4159-89bf-3902647b9e4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30bf16f5-53f2-4604-b3dc-d78cb20d3f03", "tag": "e6264105-f931-4577-95e1-871b456382d2"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:31:42.160141 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:31:42.160141 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:31:42.167400 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-c13ee1ff-92d7-4bcb-8a6b-b4e2eb7ccdc8 req-bb0ea144-6b90-4159-89bf-3902647b9e4b service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:42.167806 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-c13ee1ff-92d7-4bcb-8a6b-b4e2eb7ccdc8 req-bb0ea144-6b90-4159-89bf-3902647b9e4b service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:42.181256 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-c13ee1ff-92d7-4bcb-8a6b-b4e2eb7ccdc8 req-bb0ea144-6b90-4159-89bf-3902647b9e4b service nova] Creating event network-changed:e6264105-f931-4577-95e1-871b456382d2 for instance 30bf16f5-53f2-4604-b3dc-d78cb20d3f03 on hv-cinder-82160 Jan 18 20:31:42.187289 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-c13ee1ff-92d7-4bcb-8a6b-b4e2eb7ccdc8 req-bb0ea144-6b90-4159-89bf-3902647b9e4b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032363 Jan 18 20:31:42.187893 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 464/922] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:31:42.753300 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-2ed6ec9b-0110-448c-ae88-4d5a2273cfae tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:42.755787 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-2ed6ec9b-0110-448c-ae88-4d5a2273cfae tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] [instance: b4d3d018-f50c-46c2-9f7b-3780ac4904a2] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:42.763126 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2ed6ec9b-0110-448c-ae88-4d5a2273cfae tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:42.764044 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2ed6ec9b-0110-448c-ae88-4d5a2273cfae tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:42.764700 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2ed6ec9b-0110-448c-ae88-4d5a2273cfae tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:42.765323 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-2ed6ec9b-0110-448c-ae88-4d5a2273cfae tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:43.025121 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4927a2e0-beb4-4350-8ec0-aa0e67aa0ab2 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:43.025991 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4927a2e0-beb4-4350-8ec0-aa0e67aa0ab2 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:43.033520 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4927a2e0-beb4-4350-8ec0-aa0e67aa0ab2 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:43.034235 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4927a2e0-beb4-4350-8ec0-aa0e67aa0ab2 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:43.035310 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4927a2e0-beb4-4350-8ec0-aa0e67aa0ab2 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:43.036005 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4927a2e0-beb4-4350-8ec0-aa0e67aa0ab2 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:43.036688 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-2ed6ec9b-0110-448c-ae88-4d5a2273cfae tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '874098ef47304478851102ffe5c43a4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bde4aab26f4d339e0155939ed0fa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:43.050505 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-2ed6ec9b-0110-448c-ae88-4d5a2273cfae tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] 10.222.0.67 "GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2" status: 200 len: 1315 microversion: 2.1 time: 0.303266 Jan 18 20:31:43.059608 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 459/923] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:42 2022] GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:43.190728 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4927a2e0-beb4-4350-8ec0-aa0e67aa0ab2 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:43.198295 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4927a2e0-beb4-4350-8ec0-aa0e67aa0ab2 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03" status: 200 len: 1319 microversion: 2.1 time: 0.178044 Jan 18 20:31:43.198893 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 465/924] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:43 2022] GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:31:44.067056 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-79a53ad6-12ec-456a-b769-6949e61a2a7e tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:44.067718 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-79a53ad6-12ec-456a-b769-6949e61a2a7e tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] [instance: b4d3d018-f50c-46c2-9f7b-3780ac4904a2] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:44.074138 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-79a53ad6-12ec-456a-b769-6949e61a2a7e tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:44.074598 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-79a53ad6-12ec-456a-b769-6949e61a2a7e tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:44.075406 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-79a53ad6-12ec-456a-b769-6949e61a2a7e tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:44.075848 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-79a53ad6-12ec-456a-b769-6949e61a2a7e tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:44.216494 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-678b6f80-b9cd-41d0-9225-4cac09ebb90f tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:44.217099 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-678b6f80-b9cd-41d0-9225-4cac09ebb90f tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:44.218561 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-79a53ad6-12ec-456a-b769-6949e61a2a7e tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '874098ef47304478851102ffe5c43a4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bde4aab26f4d339e0155939ed0fa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:44.223933 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-678b6f80-b9cd-41d0-9225-4cac09ebb90f tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:44.224392 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-678b6f80-b9cd-41d0-9225-4cac09ebb90f tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:44.225322 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-678b6f80-b9cd-41d0-9225-4cac09ebb90f tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:44.225790 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-678b6f80-b9cd-41d0-9225-4cac09ebb90f tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:44.226445 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-79a53ad6-12ec-456a-b769-6949e61a2a7e tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] 10.222.0.67 "GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2" status: 200 len: 1315 microversion: 2.1 time: 0.162968 Jan 18 20:31:44.227065 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 460/925] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:44 2022] GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:44.365384 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-678b6f80-b9cd-41d0-9225-4cac09ebb90f tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:44.372845 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-678b6f80-b9cd-41d0-9225-4cac09ebb90f tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03" status: 200 len: 1319 microversion: 2.1 time: 0.160075 Jan 18 20:31:44.373423 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 466/926] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:44 2022] GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:31:45.003093 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-de739304-1a07-4c44-a71c-9bbb004bea6b req-89fc79c2-15aa-4008-98d3-e6c7a3198b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d3d018-f50c-46c2-9f7b-3780ac4904a2", "name": "network-vif-plugged", "status": "completed", "tag": "27ca9375-ea8a-4f0e-a61a-83bf6c2eb1cb"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:31:45.004736 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:31:45.004736 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:31:45.012243 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-de739304-1a07-4c44-a71c-9bbb004bea6b req-89fc79c2-15aa-4008-98d3-e6c7a3198b85 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:45.012690 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-de739304-1a07-4c44-a71c-9bbb004bea6b req-89fc79c2-15aa-4008-98d3-e6c7a3198b85 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:45.024921 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-de739304-1a07-4c44-a71c-9bbb004bea6b req-89fc79c2-15aa-4008-98d3-e6c7a3198b85 service nova] Creating event network-vif-plugged:27ca9375-ea8a-4f0e-a61a-83bf6c2eb1cb for instance b4d3d018-f50c-46c2-9f7b-3780ac4904a2 on hv-cinder-82160 Jan 18 20:31:45.029982 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-de739304-1a07-4c44-a71c-9bbb004bea6b req-89fc79c2-15aa-4008-98d3-e6c7a3198b85 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030741 Jan 18 20:31:45.030636 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 461/927] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:31:45.243284 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-20eb091e-2d3c-4061-9122-596f536c1730 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:45.243913 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-20eb091e-2d3c-4061-9122-596f536c1730 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] [instance: b4d3d018-f50c-46c2-9f7b-3780ac4904a2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:45.251674 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-20eb091e-2d3c-4061-9122-596f536c1730 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:45.252118 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-20eb091e-2d3c-4061-9122-596f536c1730 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:45.253056 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-20eb091e-2d3c-4061-9122-596f536c1730 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:45.253351 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-20eb091e-2d3c-4061-9122-596f536c1730 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:45.391246 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0365acf8-ecd3-4561-b101-9a3dfaf66f4c tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:45.392491 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0365acf8-ecd3-4561-b101-9a3dfaf66f4c tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:45.392799 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-20eb091e-2d3c-4061-9122-596f536c1730 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '874098ef47304478851102ffe5c43a4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bde4aab26f4d339e0155939ed0fa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:45.399055 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0365acf8-ecd3-4561-b101-9a3dfaf66f4c tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:45.399502 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0365acf8-ecd3-4561-b101-9a3dfaf66f4c tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:45.400286 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0365acf8-ecd3-4561-b101-9a3dfaf66f4c tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:45.400428 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-20eb091e-2d3c-4061-9122-596f536c1730 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] 10.222.0.67 "GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2" status: 200 len: 1315 microversion: 2.1 time: 0.160884 Jan 18 20:31:45.400717 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0365acf8-ecd3-4561-b101-9a3dfaf66f4c tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:45.401203 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 467/928] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:45 2022] GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:45.535297 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-0365acf8-ecd3-4561-b101-9a3dfaf66f4c tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:45.545321 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0365acf8-ecd3-4561-b101-9a3dfaf66f4c tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03" status: 200 len: 1319 microversion: 2.1 time: 0.158679 Jan 18 20:31:45.545901 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 462/929] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:45 2022] GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:31:46.418064 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9b7ab87b-6426-4d8e-8e6e-c71b27b7724b tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:46.418763 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9b7ab87b-6426-4d8e-8e6e-c71b27b7724b tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] [instance: b4d3d018-f50c-46c2-9f7b-3780ac4904a2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:46.425952 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b7ab87b-6426-4d8e-8e6e-c71b27b7724b tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:46.426410 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b7ab87b-6426-4d8e-8e6e-c71b27b7724b tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:46.427240 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b7ab87b-6426-4d8e-8e6e-c71b27b7724b tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:46.429559 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b7ab87b-6426-4d8e-8e6e-c71b27b7724b tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:46.560040 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9b7ab87b-6426-4d8e-8e6e-c71b27b7724b tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '874098ef47304478851102ffe5c43a4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bde4aab26f4d339e0155939ed0fa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:46.561852 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d2d1ee5f-48bb-4450-b2c1-c4ad0dc39ee2 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:46.562476 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d2d1ee5f-48bb-4450-b2c1-c4ad0dc39ee2 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:46.567435 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9b7ab87b-6426-4d8e-8e6e-c71b27b7724b tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] 10.222.0.67 "GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2" status: 200 len: 1465 microversion: 2.1 time: 0.153487 Jan 18 20:31:46.568008 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 468/930] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:46 2022] GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2 => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:46.569132 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d2d1ee5f-48bb-4450-b2c1-c4ad0dc39ee2 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:46.569583 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d2d1ee5f-48bb-4450-b2c1-c4ad0dc39ee2 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:46.570373 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d2d1ee5f-48bb-4450-b2c1-c4ad0dc39ee2 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:46.570813 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d2d1ee5f-48bb-4450-b2c1-c4ad0dc39ee2 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:46.603840 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3e999d40-6eeb-4026-828b-fd1a45588d82 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:46.604334 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3e999d40-6eeb-4026-828b-fd1a45588d82 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] [instance: b4d3d018-f50c-46c2-9f7b-3780ac4904a2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:46.610917 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3e999d40-6eeb-4026-828b-fd1a45588d82 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:46.611445 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3e999d40-6eeb-4026-828b-fd1a45588d82 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:46.612225 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3e999d40-6eeb-4026-828b-fd1a45588d82 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:46.612677 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3e999d40-6eeb-4026-828b-fd1a45588d82 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:46.637925 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3e999d40-6eeb-4026-828b-fd1a45588d82 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] [instance: b4d3d018-f50c-46c2-9f7b-3780ac4904a2] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:31:46.708171 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d2d1ee5f-48bb-4450-b2c1-c4ad0dc39ee2 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:46.714570 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3e999d40-6eeb-4026-828b-fd1a45588d82 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2" status: 204 len: 0 microversion: 2.1 time: 0.114102 Jan 18 20:31:46.715290 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 469/931] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:31:46 2022] DELETE /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 18 20:31:46.718292 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d2d1ee5f-48bb-4450-b2c1-c4ad0dc39ee2 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03" status: 200 len: 1319 microversion: 2.1 time: 0.158715 Jan 18 20:31:46.718292 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 463/932] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:46 2022] GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:31:46.724059 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3b2e4fbd-8687-4461-bbf4-7c36299e7505 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:46.724889 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3b2e4fbd-8687-4461-bbf4-7c36299e7505 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] [instance: b4d3d018-f50c-46c2-9f7b-3780ac4904a2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:46.730868 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3b2e4fbd-8687-4461-bbf4-7c36299e7505 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:46.731353 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3b2e4fbd-8687-4461-bbf4-7c36299e7505 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:46.732129 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3b2e4fbd-8687-4461-bbf4-7c36299e7505 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:46.732569 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3b2e4fbd-8687-4461-bbf4-7c36299e7505 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:46.869730 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3b2e4fbd-8687-4461-bbf4-7c36299e7505 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '874098ef47304478851102ffe5c43a4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bde4aab26f4d339e0155939ed0fa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:46.877142 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3b2e4fbd-8687-4461-bbf4-7c36299e7505 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] 10.222.0.67 "GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2" status: 200 len: 1471 microversion: 2.1 time: 0.157416 Jan 18 20:31:46.877701 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 470/933] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:46 2022] GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:31:47.734262 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-555ff22f-916d-44ef-85b3-b479b033de62 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:47.734939 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-555ff22f-916d-44ef-85b3-b479b033de62 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:47.741807 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-555ff22f-916d-44ef-85b3-b479b033de62 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:47.742260 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-555ff22f-916d-44ef-85b3-b479b033de62 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:47.743057 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-555ff22f-916d-44ef-85b3-b479b033de62 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:47.743510 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-555ff22f-916d-44ef-85b3-b479b033de62 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:47.870773 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-555ff22f-916d-44ef-85b3-b479b033de62 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:47.878591 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-555ff22f-916d-44ef-85b3-b479b033de62 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03" status: 200 len: 1319 microversion: 2.1 time: 0.148021 Jan 18 20:31:47.879171 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 464/934] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:47 2022] GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:47.893564 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-735e53a6-2f76-4471-853e-bd6a3ecf528c tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:47.894173 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-735e53a6-2f76-4471-853e-bd6a3ecf528c tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] [instance: b4d3d018-f50c-46c2-9f7b-3780ac4904a2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:47.900489 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-735e53a6-2f76-4471-853e-bd6a3ecf528c tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:47.900936 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-735e53a6-2f76-4471-853e-bd6a3ecf528c tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:47.901716 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-735e53a6-2f76-4471-853e-bd6a3ecf528c tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:47.902172 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-735e53a6-2f76-4471-853e-bd6a3ecf528c tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:48.029348 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-735e53a6-2f76-4471-853e-bd6a3ecf528c tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '874098ef47304478851102ffe5c43a4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bde4aab26f4d339e0155939ed0fa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:48.037147 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-735e53a6-2f76-4471-853e-bd6a3ecf528c tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] 10.222.0.67 "GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2" status: 200 len: 1471 microversion: 2.1 time: 0.147268 Jan 18 20:31:48.037716 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 471/935] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:47 2022] GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2 => generated 1471 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:48.570044 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-d7e90621-78ed-4b56-a8ec-dc7b645b9767 req-478eaea4-0ae5-44d2-9601-ecb05ffbe547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d3d018-f50c-46c2-9f7b-3780ac4904a2", "name": "network-vif-deleted", "tag": "27ca9375-ea8a-4f0e-a61a-83bf6c2eb1cb"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:31:48.575953 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:31:48.575953 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:31:48.587377 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-d7e90621-78ed-4b56-a8ec-dc7b645b9767 req-478eaea4-0ae5-44d2-9601-ecb05ffbe547 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:48.588217 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-d7e90621-78ed-4b56-a8ec-dc7b645b9767 req-478eaea4-0ae5-44d2-9601-ecb05ffbe547 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:48.603282 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-d7e90621-78ed-4b56-a8ec-dc7b645b9767 req-478eaea4-0ae5-44d2-9601-ecb05ffbe547 service nova] Creating event network-vif-deleted:27ca9375-ea8a-4f0e-a61a-83bf6c2eb1cb for instance b4d3d018-f50c-46c2-9f7b-3780ac4904a2 on hv-cinder-82160 Jan 18 20:31:48.609161 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-d7e90621-78ed-4b56-a8ec-dc7b645b9767 req-478eaea4-0ae5-44d2-9601-ecb05ffbe547 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047787 Jan 18 20:31:48.610061 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 465/936] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:31:48.896081 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3fa4a482-f256-448d-8699-c51aabd45248 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:48.896677 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3fa4a482-f256-448d-8699-c51aabd45248 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:48.903468 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3fa4a482-f256-448d-8699-c51aabd45248 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:48.903909 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3fa4a482-f256-448d-8699-c51aabd45248 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:48.904904 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3fa4a482-f256-448d-8699-c51aabd45248 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:48.905337 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3fa4a482-f256-448d-8699-c51aabd45248 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:49.030362 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-8d677bb4-f163-4eec-b038-9d7fc366f3ca req-2e2c224d-b46b-490b-8d7f-306e71eb94dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30bf16f5-53f2-4604-b3dc-d78cb20d3f03", "name": "network-vif-plugged", "status": "completed", "tag": "e6264105-f931-4577-95e1-871b456382d2"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:31:49.033175 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:31:49.033175 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:31:49.042816 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-8d677bb4-f163-4eec-b038-9d7fc366f3ca req-2e2c224d-b46b-490b-8d7f-306e71eb94dd service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:49.043557 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-8d677bb4-f163-4eec-b038-9d7fc366f3ca req-2e2c224d-b46b-490b-8d7f-306e71eb94dd service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:49.057378 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-8d677bb4-f163-4eec-b038-9d7fc366f3ca req-2e2c224d-b46b-490b-8d7f-306e71eb94dd service nova] Creating event network-vif-plugged:e6264105-f931-4577-95e1-871b456382d2 for instance 30bf16f5-53f2-4604-b3dc-d78cb20d3f03 on hv-cinder-82160 Jan 18 20:31:49.062875 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-8d677bb4-f163-4eec-b038-9d7fc366f3ca req-2e2c224d-b46b-490b-8d7f-306e71eb94dd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037270 Jan 18 20:31:49.064914 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 466/937] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:31:49.080021 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-01d9906f-3e7e-47cd-954c-a95556bafb76 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:49.081024 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-01d9906f-3e7e-47cd-954c-a95556bafb76 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] [instance: b4d3d018-f50c-46c2-9f7b-3780ac4904a2] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:49.089293 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-01d9906f-3e7e-47cd-954c-a95556bafb76 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:49.090024 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-01d9906f-3e7e-47cd-954c-a95556bafb76 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:49.091244 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-01d9906f-3e7e-47cd-954c-a95556bafb76 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:49.091837 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-01d9906f-3e7e-47cd-954c-a95556bafb76 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:49.132625 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-01d9906f-3e7e-47cd-954c-a95556bafb76 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:49.133339 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-01d9906f-3e7e-47cd-954c-a95556bafb76 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:49.133984 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.objects.instance [None req-01d9906f-3e7e-47cd-954c-a95556bafb76 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lazy-loading 'fault' on Instance uuid b4d3d018-f50c-46c2-9f7b-3780ac4904a2 {{(pid=116376) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:31:49.180683 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-01d9906f-3e7e-47cd-954c-a95556bafb76 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '874098ef47304478851102ffe5c43a4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bde4aab26f4d339e0155939ed0fa83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:49.189462 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-01d9906f-3e7e-47cd-954c-a95556bafb76 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] 10.222.0.67 "GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2" status: 200 len: 1305 microversion: 2.1 time: 0.115226 Jan 18 20:31:49.190041 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 467/938] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:49 2022] GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2 => generated 1305 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:49.217519 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3fa4a482-f256-448d-8699-c51aabd45248 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:49.224965 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3fa4a482-f256-448d-8699-c51aabd45248 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03" status: 200 len: 1319 microversion: 2.1 time: 0.333070 Jan 18 20:31:49.225543 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 472/939] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:48 2022] GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03 => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:49.490244 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-520b7bd4-a221-4972-b880-e26d1d6c09a2 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:49.491131 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-520b7bd4-a221-4972-b880-e26d1d6c09a2 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:49.499469 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-520b7bd4-a221-4972-b880-e26d1d6c09a2 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:49.499920 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-520b7bd4-a221-4972-b880-e26d1d6c09a2 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:49.500738 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-520b7bd4-a221-4972-b880-e26d1d6c09a2 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:49.501171 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-520b7bd4-a221-4972-b880-e26d1d6c09a2 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:49.530761 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-520b7bd4-a221-4972-b880-e26d1d6c09a2 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Going to try to terminate instance {{(pid=116376) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:31:49.622889 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-520b7bd4-a221-4972-b880-e26d1d6c09a2 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 204 len: 0 microversion: 2.1 time: 0.135743 Jan 18 20:31:49.624784 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 468/940] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:31:49 2022] DELETE /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:31:49.634343 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-35e03c43-1169-4192-9c07-2afebdedae5e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:49.635232 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-35e03c43-1169-4192-9c07-2afebdedae5e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:49.641749 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-35e03c43-1169-4192-9c07-2afebdedae5e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:49.642199 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-35e03c43-1169-4192-9c07-2afebdedae5e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:49.643323 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-35e03c43-1169-4192-9c07-2afebdedae5e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:49.643758 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-35e03c43-1169-4192-9c07-2afebdedae5e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:49.647609 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-a0dd017b-d296-4452-9f24-f273368679ba req-af429513-5192-4b4e-80c3-c5675caa2fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3922fa1-08be-4eee-9088-5ccf7cf4014e", "tag": "f1f716af-ae09-4a01-8a29-d7bb8bff9321"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:31:49.649184 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:31:49.649184 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:31:49.656692 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-a0dd017b-d296-4452-9f24-f273368679ba req-af429513-5192-4b4e-80c3-c5675caa2fc9 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:49.657940 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-a0dd017b-d296-4452-9f24-f273368679ba req-af429513-5192-4b4e-80c3-c5675caa2fc9 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:49.670248 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-a0dd017b-d296-4452-9f24-f273368679ba req-af429513-5192-4b4e-80c3-c5675caa2fc9 service nova] Creating event network-changed:f1f716af-ae09-4a01-8a29-d7bb8bff9321 for instance d3922fa1-08be-4eee-9088-5ccf7cf4014e on hv-cinder-82160 Jan 18 20:31:49.675878 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-a0dd017b-d296-4452-9f24-f273368679ba req-af429513-5192-4b4e-80c3-c5675caa2fc9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187450 Jan 18 20:31:49.676518 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 473/941] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:31:49.856313 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-35e03c43-1169-4192-9c07-2afebdedae5e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:49.868781 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-35e03c43-1169-4192-9c07-2afebdedae5e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1567 microversion: 2.1 time: 0.239273 Jan 18 20:31:49.870199 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 469/942] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:49 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:31:50.207443 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1ec7c512-3691-4f43-9fde-3fe3d8e711c2 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:50.208051 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1ec7c512-3691-4f43-9fde-3fe3d8e711c2 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] [instance: b4d3d018-f50c-46c2-9f7b-3780ac4904a2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:50.214902 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ec7c512-3691-4f43-9fde-3fe3d8e711c2 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:50.215687 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ec7c512-3691-4f43-9fde-3fe3d8e711c2 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:50.216546 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ec7c512-3691-4f43-9fde-3fe3d8e711c2 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:50.217055 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ec7c512-3691-4f43-9fde-3fe3d8e711c2 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:50.230852 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-1ec7c512-3691-4f43-9fde-3fe3d8e711c2 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] HTTP exception thrown: Instance b4d3d018-f50c-46c2-9f7b-3780ac4904a2 could not be found. Jan 18 20:31:50.231496 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1ec7c512-3691-4f43-9fde-3fe3d8e711c2 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] Returning 404 to user: Instance b4d3d018-f50c-46c2-9f7b-3780ac4904a2 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:31:50.232338 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1ec7c512-3691-4f43-9fde-3fe3d8e711c2 tempest-VolumesNegativeTest-1961841034 tempest-VolumesNegativeTest-1961841034-project] 10.222.0.67 "GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2" status: 404 len: 111 microversion: 2.1 time: 0.030355 Jan 18 20:31:50.233093 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 474/943] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:50 2022] GET /compute/v2.1/servers/b4d3d018-f50c-46c2-9f7b-3780ac4904a2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:31:50.246072 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-21a9c486-e6d0-4409-8f97-b236dfdf1a80 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:50.247460 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-21a9c486-e6d0-4409-8f97-b236dfdf1a80 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:50.260737 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-21a9c486-e6d0-4409-8f97-b236dfdf1a80 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:50.261282 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-21a9c486-e6d0-4409-8f97-b236dfdf1a80 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:50.262147 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-21a9c486-e6d0-4409-8f97-b236dfdf1a80 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:50.262655 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-21a9c486-e6d0-4409-8f97-b236dfdf1a80 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:50.413739 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-21a9c486-e6d0-4409-8f97-b236dfdf1a80 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:50.421544 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-21a9c486-e6d0-4409-8f97-b236dfdf1a80 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03" status: 200 len: 1319 microversion: 2.1 time: 0.180071 Jan 18 20:31:50.432113 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 470/944] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:50 2022] GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:50.888905 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5ccd1e32-38b5-4f57-95fe-4aad7293d375 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:50.890022 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5ccd1e32-38b5-4f57-95fe-4aad7293d375 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:50.896139 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5ccd1e32-38b5-4f57-95fe-4aad7293d375 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:50.896584 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5ccd1e32-38b5-4f57-95fe-4aad7293d375 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:50.897360 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5ccd1e32-38b5-4f57-95fe-4aad7293d375 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:50.897821 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5ccd1e32-38b5-4f57-95fe-4aad7293d375 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:51.040288 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5ccd1e32-38b5-4f57-95fe-4aad7293d375 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:51.049367 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5ccd1e32-38b5-4f57-95fe-4aad7293d375 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1449 microversion: 2.1 time: 0.165437 Jan 18 20:31:51.049997 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 475/945] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:50 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:51.440786 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5c0d0213-1c9f-4322-9de9-2d39ba609bbb tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:51.441691 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-5c0d0213-1c9f-4322-9de9-2d39ba609bbb tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:51.453488 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5c0d0213-1c9f-4322-9de9-2d39ba609bbb tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:51.454485 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5c0d0213-1c9f-4322-9de9-2d39ba609bbb tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:51.455339 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5c0d0213-1c9f-4322-9de9-2d39ba609bbb tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:51.455774 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5c0d0213-1c9f-4322-9de9-2d39ba609bbb tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:51.685454 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-5c0d0213-1c9f-4322-9de9-2d39ba609bbb tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:51.694425 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-5c0d0213-1c9f-4322-9de9-2d39ba609bbb tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03" status: 200 len: 1507 microversion: 2.1 time: 0.257600 Jan 18 20:31:51.695223 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 471/946] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:51 2022] GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03 => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:31:51.972544 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-6781509b-2a17-4651-ab9f-9c62001c4fd0 req-1df17b98-7715-4f92-b57e-9265c36cd755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3922fa1-08be-4eee-9088-5ccf7cf4014e", "name": "network-vif-deleted", "tag": "f1f716af-ae09-4a01-8a29-d7bb8bff9321"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:31:51.975224 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:31:51.975224 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:31:51.985488 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-6781509b-2a17-4651-ab9f-9c62001c4fd0 req-1df17b98-7715-4f92-b57e-9265c36cd755 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:51.985988 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-6781509b-2a17-4651-ab9f-9c62001c4fd0 req-1df17b98-7715-4f92-b57e-9265c36cd755 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:52.003322 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-6781509b-2a17-4651-ab9f-9c62001c4fd0 req-1df17b98-7715-4f92-b57e-9265c36cd755 service nova] Creating event network-vif-deleted:f1f716af-ae09-4a01-8a29-d7bb8bff9321 for instance d3922fa1-08be-4eee-9088-5ccf7cf4014e on hv-cinder-82160 Jan 18 20:31:52.009513 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-6781509b-2a17-4651-ab9f-9c62001c4fd0 req-1df17b98-7715-4f92-b57e-9265c36cd755 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041218 Jan 18 20:31:52.010119 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 476/947] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:31:52.067751 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ceb94229-b68a-413f-8203-cf572ee595a6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:52.068471 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ceb94229-b68a-413f-8203-cf572ee595a6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:52.074949 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ceb94229-b68a-413f-8203-cf572ee595a6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:52.075488 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ceb94229-b68a-413f-8203-cf572ee595a6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:52.076454 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ceb94229-b68a-413f-8203-cf572ee595a6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:52.077062 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-ceb94229-b68a-413f-8203-cf572ee595a6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:52.145015 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-ceb94229-b68a-413f-8203-cf572ee595a6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ed9ec315254412868a0b323e8dad59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32060f3477d348b7bb92a2240bec099f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:31:52.153621 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ceb94229-b68a-413f-8203-cf572ee595a6 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 200 len: 1220 microversion: 2.1 time: 0.090046 Jan 18 20:31:52.154910 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 472/948] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:52 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:31:53.170816 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e08656a6-a5b5-4f31-8796-80131ac82eb4 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:53.171813 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e08656a6-a5b5-4f31-8796-80131ac82eb4 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] [instance: d3922fa1-08be-4eee-9088-5ccf7cf4014e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:31:53.178869 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e08656a6-a5b5-4f31-8796-80131ac82eb4 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:53.179561 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e08656a6-a5b5-4f31-8796-80131ac82eb4 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:53.180720 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e08656a6-a5b5-4f31-8796-80131ac82eb4 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:31:53.181247 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e08656a6-a5b5-4f31-8796-80131ac82eb4 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:31:53.197469 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-e08656a6-a5b5-4f31-8796-80131ac82eb4 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] HTTP exception thrown: Instance d3922fa1-08be-4eee-9088-5ccf7cf4014e could not be found. Jan 18 20:31:53.198078 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e08656a6-a5b5-4f31-8796-80131ac82eb4 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Returning 404 to user: Instance d3922fa1-08be-4eee-9088-5ccf7cf4014e could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:31:53.198921 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e08656a6-a5b5-4f31-8796-80131ac82eb4 tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e" status: 404 len: 111 microversion: 2.1 time: 0.032950 Jan 18 20:31:53.199509 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 477/949] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:31:53 2022] GET /compute/v2.1/servers/d3922fa1-08be-4eee-9088-5ccf7cf4014e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:31:53.377048 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ff670a0d-3e7f-46d9-846d-d43a8048060e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] Calling method '.version_select at 0x7f1782d44160>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:31:53.404832 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ff670a0d-3e7f-46d9-846d-d43a8048060e tempest-TestShelveInstance-399208328 tempest-TestShelveInstance-399208328-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1147709869" status: 202 len: 0 microversion: 2.1 time: 0.031522 Jan 18 20:31:53.405419 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 473/950] 10.222.0.67 () {58 vars in 1253 bytes} [Tue Jan 18 20:31:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1147709869 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:32:07.046022 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-09c09363-4fe9-4bca-92f0-78857027268e tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2367d6ca-7444-42d7-8155-3344bdc240e8", "device": "/dev/sdb"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:32:07.047861 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-09c09363-4fe9-4bca-92f0-78857027268e tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:07.054570 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-09c09363-4fe9-4bca-92f0-78857027268e tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:07.055042 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-09c09363-4fe9-4bca-92f0-78857027268e tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:07.055845 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-09c09363-4fe9-4bca-92f0-78857027268e tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:07.056287 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-09c09363-4fe9-4bca-92f0-78857027268e tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:07.332019 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-09c09363-4fe9-4bca-92f0-78857027268e tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "POST /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290366 Jan 18 20:32:07.332975 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 478/951] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Jan 18 20:32:07 2022] POST /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:32:11.350567 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-887e41e7-dc81-412c-a9cc-c7078554df9c tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Action: 'create', calling method: .version_select at 0x7f1782ebf280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2140880239"}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:32:11.366061 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-887e41e7-dc81-412c-a9cc-c7078554df9c tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Getting quotas for project 4da1bb9e68f340d5b32fa2a5916db726. Resources: {'key_pairs'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:32:11.371725 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-887e41e7-dc81-412c-a9cc-c7078554df9c tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Getting quotas for user 86f9f8e0b3374628a563831c0b74a06e and project 4da1bb9e68f340d5b32fa2a5916db726. Resources: {'key_pairs'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:32:11.941577 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-887e41e7-dc81-412c-a9cc-c7078554df9c tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Getting quotas for project 4da1bb9e68f340d5b32fa2a5916db726. Resources: {'key_pairs'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:32:11.945353 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-887e41e7-dc81-412c-a9cc-c7078554df9c tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Getting quotas for user 86f9f8e0b3374628a563831c0b74a06e and project 4da1bb9e68f340d5b32fa2a5916db726. Resources: {'key_pairs'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:32:11.958392 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-887e41e7-dc81-412c-a9cc-c7078554df9c tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.779953 Jan 18 20:32:11.964526 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 474/952] 10.222.0.67 () {60 vars in 1157 bytes} [Tue Jan 18 20:32:11 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:29.938913 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8c8531bd-93a9-4888-8e69-d4216bc33c00 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:29.939536 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8c8531bd-93a9-4888-8e69-d4216bc33c00 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:29.946290 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c8531bd-93a9-4888-8e69-d4216bc33c00 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:29.946739 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c8531bd-93a9-4888-8e69-d4216bc33c00 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:29.947559 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c8531bd-93a9-4888-8e69-d4216bc33c00 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:29.947997 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c8531bd-93a9-4888-8e69-d4216bc33c00 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:30.030597 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-8c8531bd-93a9-4888-8e69-d4216bc33c00 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lazy-loading 'services' on Instance uuid 30bf16f5-53f2-4604-b3dc-d78cb20d3f03 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:32:30.099805 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8c8531bd-93a9-4888-8e69-d4216bc33c00 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "DELETE /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03/os-volume_attachments/2367d6ca-7444-42d7-8155-3344bdc240e8" status: 202 len: 0 microversion: 2.1 time: 0.165354 Jan 18 20:32:30.100637 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 479/953] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Jan 18 20:32:29 2022] DELETE /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03/os-volume_attachments/2367d6ca-7444-42d7-8155-3344bdc240e8 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:32:31.212625 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fbf6dec3-fa17-4fa0-ae51-6424c1e804ed tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:31.213157 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-fbf6dec3-fa17-4fa0-ae51-6424c1e804ed tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:31.218989 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fbf6dec3-fa17-4fa0-ae51-6424c1e804ed tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:31.219469 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fbf6dec3-fa17-4fa0-ae51-6424c1e804ed tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:31.220288 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fbf6dec3-fa17-4fa0-ae51-6424c1e804ed tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:31.220687 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fbf6dec3-fa17-4fa0-ae51-6424c1e804ed tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:31.246332 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-fbf6dec3-fa17-4fa0-ae51-6424c1e804ed tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Going to try to terminate instance {{(pid=116376) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:32:31.319328 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ad119f29-3f87-4ad0-a3d4-714f37ab590f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1392327698", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2140880239", "security_groups": [{"name": "tempest-secgroup-smoke-864406677"}], "block_device_mapping_v2": [{"uuid": "906f0ae9-7af3-4562-a7a9-de06b4d2e7a1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3d41f18b-a9a9-452f-a56b-ae5f33323ec9"}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:32:31.331822 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-fbf6dec3-fa17-4fa0-ae51-6424c1e804ed tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "DELETE /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03" status: 204 len: 0 microversion: 2.1 time: 0.123122 Jan 18 20:32:31.332671 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 475/954] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:32:31 2022] DELETE /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:32:31.341139 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-1dadcb9d-4b05-4037-b305-8f9126a8e050 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:31.341845 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-1dadcb9d-4b05-4037-b305-8f9126a8e050 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:31.348902 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1dadcb9d-4b05-4037-b305-8f9126a8e050 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:31.349363 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1dadcb9d-4b05-4037-b305-8f9126a8e050 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:31.350134 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1dadcb9d-4b05-4037-b305-8f9126a8e050 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:31.350566 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-1dadcb9d-4b05-4037-b305-8f9126a8e050 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:31.439263 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-ad119f29-3f87-4ad0-a3d4-714f37ab590f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] validate_networks() for [('3d41f18b-a9a9-452f-a56b-ae5f33323ec9', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:32:31.485522 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-1dadcb9d-4b05-4037-b305-8f9126a8e050 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:31.493520 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-1dadcb9d-4b05-4037-b305-8f9126a8e050 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03" status: 200 len: 1513 microversion: 2.1 time: 0.156507 Jan 18 20:32:31.494091 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 476/955] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:31 2022] GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:32:31.800153 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-ad119f29-3f87-4ad0-a3d4-714f37ab590f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:32:31.800568 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-ad119f29-3f87-4ad0-a3d4-714f37ab590f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:32:31.801060 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-ad119f29-3f87-4ad0-a3d4-714f37ab590f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:32:31.801492 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-ad119f29-3f87-4ad0-a3d4-714f37ab590f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:32:31.801894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-ad119f29-3f87-4ad0-a3d4-714f37ab590f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:32:31.810641 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ad119f29-3f87-4ad0-a3d4-714f37ab590f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:31.811137 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ad119f29-3f87-4ad0-a3d4-714f37ab590f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:31.811954 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ad119f29-3f87-4ad0-a3d4-714f37ab590f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:31.812389 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ad119f29-3f87-4ad0-a3d4-714f37ab590f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:31.828917 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-ad119f29-3f87-4ad0-a3d4-714f37ab590f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Getting quotas for project 4da1bb9e68f340d5b32fa2a5916db726. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:32:31.833367 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-ad119f29-3f87-4ad0-a3d4-714f37ab590f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Getting quotas for user 86f9f8e0b3374628a563831c0b74a06e and project 4da1bb9e68f340d5b32fa2a5916db726. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:32:31.888751 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ad119f29-3f87-4ad0-a3d4-714f37ab590f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:32:31.890971 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ad119f29-3f87-4ad0-a3d4-714f37ab590f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='906f0ae9-7af3-4562-a7a9-de06b4d2e7a1',volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:32:32.018861 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ad119f29-3f87-4ad0-a3d4-714f37ab590f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.704106 Jan 18 20:32:32.025418 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 480/956] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:32:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 18 20:32:32.030264 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-de47ac82-3c6f-44c5-93ae-51a5dd6eac86 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:32.030951 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-de47ac82-3c6f-44c5-93ae-51a5dd6eac86 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:32.095674 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-de47ac82-3c6f-44c5-93ae-51a5dd6eac86 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:32.102097 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-de47ac82-3c6f-44c5-93ae-51a5dd6eac86 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1095 microversion: 2.1 time: 0.075589 Jan 18 20:32:32.102647 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 477/957] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:32 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:32.509988 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b687480b-bd69-4d6d-b903-e23ae0b06dc3 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:32.510621 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b687480b-bd69-4d6d-b903-e23ae0b06dc3 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:32.516940 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b687480b-bd69-4d6d-b903-e23ae0b06dc3 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:32.517387 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b687480b-bd69-4d6d-b903-e23ae0b06dc3 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:32.518167 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b687480b-bd69-4d6d-b903-e23ae0b06dc3 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:32.518608 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b687480b-bd69-4d6d-b903-e23ae0b06dc3 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:32.658579 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b687480b-bd69-4d6d-b903-e23ae0b06dc3 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:32.667795 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b687480b-bd69-4d6d-b903-e23ae0b06dc3 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03" status: 200 len: 1513 microversion: 2.1 time: 0.161669 Jan 18 20:32:32.668363 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 481/958] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:32 2022] GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:33.121207 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a3c19dc5-89f7-413c-baae-549e660a68be tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:33.121830 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-a3c19dc5-89f7-413c-baae-549e660a68be tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:33.130765 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a3c19dc5-89f7-413c-baae-549e660a68be tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:33.131524 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a3c19dc5-89f7-413c-baae-549e660a68be tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:33.132532 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a3c19dc5-89f7-413c-baae-549e660a68be tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:33.133124 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a3c19dc5-89f7-413c-baae-549e660a68be tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:33.214590 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a3c19dc5-89f7-413c-baae-549e660a68be tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:33.222220 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a3c19dc5-89f7-413c-baae-549e660a68be tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1211 microversion: 2.1 time: 0.106495 Jan 18 20:32:33.231765 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 478/959] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:33 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:33.494986 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-e95e5a23-e30a-4e11-8ea3-98db7205e0af req-4d40097e-d31d-466a-8f85-e89988b9a857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30bf16f5-53f2-4604-b3dc-d78cb20d3f03", "name": "network-vif-deleted", "tag": "e6264105-f931-4577-95e1-871b456382d2"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:32:33.496614 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:32:33.496614 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:32:33.505144 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-e95e5a23-e30a-4e11-8ea3-98db7205e0af req-4d40097e-d31d-466a-8f85-e89988b9a857 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:33.506235 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-e95e5a23-e30a-4e11-8ea3-98db7205e0af req-4d40097e-d31d-466a-8f85-e89988b9a857 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:33.518794 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-e95e5a23-e30a-4e11-8ea3-98db7205e0af req-4d40097e-d31d-466a-8f85-e89988b9a857 service nova] Creating event network-vif-deleted:e6264105-f931-4577-95e1-871b456382d2 for instance 30bf16f5-53f2-4604-b3dc-d78cb20d3f03 on hv-cinder-82160 Jan 18 20:32:33.526609 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-e95e5a23-e30a-4e11-8ea3-98db7205e0af req-4d40097e-d31d-466a-8f85-e89988b9a857 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035020 Jan 18 20:32:33.527272 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 482/960] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:32:33.685471 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-9def0ca7-0dac-4fce-8795-09024847b2c8 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:33.686184 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-9def0ca7-0dac-4fce-8795-09024847b2c8 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:33.692839 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9def0ca7-0dac-4fce-8795-09024847b2c8 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:33.693524 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9def0ca7-0dac-4fce-8795-09024847b2c8 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:33.694382 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9def0ca7-0dac-4fce-8795-09024847b2c8 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:33.695021 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9def0ca7-0dac-4fce-8795-09024847b2c8 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:33.730363 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9def0ca7-0dac-4fce-8795-09024847b2c8 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:33.730814 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9def0ca7-0dac-4fce-8795-09024847b2c8 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:33.731291 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.objects.instance [None req-9def0ca7-0dac-4fce-8795-09024847b2c8 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lazy-loading 'fault' on Instance uuid 30bf16f5-53f2-4604-b3dc-d78cb20d3f03 {{(pid=116376) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:32:33.785173 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-9def0ca7-0dac-4fce-8795-09024847b2c8 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:33.796699 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-9def0ca7-0dac-4fce-8795-09024847b2c8 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03" status: 200 len: 1309 microversion: 2.1 time: 0.115122 Jan 18 20:32:33.799066 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 479/961] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:33 2022] GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03 => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:34.241113 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9b0515ed-4346-488c-8d4f-ae2d2ed80076 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:34.242155 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9b0515ed-4346-488c-8d4f-ae2d2ed80076 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:34.249901 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b0515ed-4346-488c-8d4f-ae2d2ed80076 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:34.250409 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b0515ed-4346-488c-8d4f-ae2d2ed80076 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:34.251235 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b0515ed-4346-488c-8d4f-ae2d2ed80076 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:34.251665 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b0515ed-4346-488c-8d4f-ae2d2ed80076 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:34.396578 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9b0515ed-4346-488c-8d4f-ae2d2ed80076 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:34.404107 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9b0515ed-4346-488c-8d4f-ae2d2ed80076 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1266 microversion: 2.1 time: 0.168130 Jan 18 20:32:34.404685 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 483/962] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:34 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:34.448418 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-3bc377b3-61a3-4f66-8382-f74ff86b79f1 req-42edf84a-761c-44dc-9e16-35fb50346e6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda8f88c-10d2-4afa-9257-97a6d029f4bf", "tag": "7d42978d-d72f-41b6-aced-e2a13e4efa4b"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:32:34.449977 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:32:34.449977 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:32:34.458715 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-3bc377b3-61a3-4f66-8382-f74ff86b79f1 req-42edf84a-761c-44dc-9e16-35fb50346e6d service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:34.461454 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-3bc377b3-61a3-4f66-8382-f74ff86b79f1 req-42edf84a-761c-44dc-9e16-35fb50346e6d service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:34.474701 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-3bc377b3-61a3-4f66-8382-f74ff86b79f1 req-42edf84a-761c-44dc-9e16-35fb50346e6d service nova] Creating event network-changed:7d42978d-d72f-41b6-aced-e2a13e4efa4b for instance eda8f88c-10d2-4afa-9257-97a6d029f4bf on hv-cinder-82160 Jan 18 20:32:34.479585 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-3bc377b3-61a3-4f66-8382-f74ff86b79f1 req-42edf84a-761c-44dc-9e16-35fb50346e6d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036230 Jan 18 20:32:34.480252 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 480/963] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:32:34.813465 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b58d6574-50b3-4a88-858b-819a4738e926 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:34.814064 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b58d6574-50b3-4a88-858b-819a4738e926 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 30bf16f5-53f2-4604-b3dc-d78cb20d3f03] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:34.820900 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b58d6574-50b3-4a88-858b-819a4738e926 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:34.821342 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b58d6574-50b3-4a88-858b-819a4738e926 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:34.822115 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b58d6574-50b3-4a88-858b-819a4738e926 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:34.822541 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b58d6574-50b3-4a88-858b-819a4738e926 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:34.836858 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-b58d6574-50b3-4a88-858b-819a4738e926 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] HTTP exception thrown: Instance 30bf16f5-53f2-4604-b3dc-d78cb20d3f03 could not be found. Jan 18 20:32:34.837447 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b58d6574-50b3-4a88-858b-819a4738e926 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Returning 404 to user: Instance 30bf16f5-53f2-4604-b3dc-d78cb20d3f03 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:32:34.838279 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b58d6574-50b3-4a88-858b-819a4738e926 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03" status: 404 len: 111 microversion: 2.1 time: 0.028526 Jan 18 20:32:34.838848 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 484/964] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:34 2022] GET /compute/v2.1/servers/30bf16f5-53f2-4604-b3dc-d78cb20d3f03 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:32:35.422292 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7e8e4674-af38-42a4-8bdb-7ac5c78ad741 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:35.422997 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-7e8e4674-af38-42a4-8bdb-7ac5c78ad741 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:35.429137 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7e8e4674-af38-42a4-8bdb-7ac5c78ad741 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:35.429593 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7e8e4674-af38-42a4-8bdb-7ac5c78ad741 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:35.430372 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7e8e4674-af38-42a4-8bdb-7ac5c78ad741 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:35.430809 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7e8e4674-af38-42a4-8bdb-7ac5c78ad741 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:35.561572 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-7e8e4674-af38-42a4-8bdb-7ac5c78ad741 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:35.568895 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7e8e4674-af38-42a4-8bdb-7ac5c78ad741 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1266 microversion: 2.1 time: 0.150951 Jan 18 20:32:35.569453 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 481/965] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:35 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:36.585995 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bc4da110-d6ae-4240-b1fa-7d9370f3bd54 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:36.586596 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bc4da110-d6ae-4240-b1fa-7d9370f3bd54 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:36.592941 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bc4da110-d6ae-4240-b1fa-7d9370f3bd54 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:36.593388 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bc4da110-d6ae-4240-b1fa-7d9370f3bd54 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:36.594156 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bc4da110-d6ae-4240-b1fa-7d9370f3bd54 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:36.594585 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bc4da110-d6ae-4240-b1fa-7d9370f3bd54 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:36.724511 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bc4da110-d6ae-4240-b1fa-7d9370f3bd54 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:36.731808 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bc4da110-d6ae-4240-b1fa-7d9370f3bd54 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1266 microversion: 2.1 time: 0.150106 Jan 18 20:32:36.732360 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 485/966] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:36 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:37.747679 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-bbbc6326-f6cd-426e-bc02-6ab35165b666 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:37.748295 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-bbbc6326-f6cd-426e-bc02-6ab35165b666 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:37.754568 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bbbc6326-f6cd-426e-bc02-6ab35165b666 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:37.755070 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bbbc6326-f6cd-426e-bc02-6ab35165b666 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:37.755859 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bbbc6326-f6cd-426e-bc02-6ab35165b666 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:37.756297 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bbbc6326-f6cd-426e-bc02-6ab35165b666 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:37.974064 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-bbbc6326-f6cd-426e-bc02-6ab35165b666 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:37.981264 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-bbbc6326-f6cd-426e-bc02-6ab35165b666 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1266 microversion: 2.1 time: 0.237245 Jan 18 20:32:37.981835 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 482/967] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:37 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:38.999334 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-83a9474d-fa0e-4c66-8e10-f46dfaf81a0c tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:38.999979 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-83a9474d-fa0e-4c66-8e10-f46dfaf81a0c tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:39.006820 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83a9474d-fa0e-4c66-8e10-f46dfaf81a0c tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:39.007303 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83a9474d-fa0e-4c66-8e10-f46dfaf81a0c tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:39.008092 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83a9474d-fa0e-4c66-8e10-f46dfaf81a0c tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:39.008531 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83a9474d-fa0e-4c66-8e10-f46dfaf81a0c tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:39.136182 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-83a9474d-fa0e-4c66-8e10-f46dfaf81a0c tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:39.143504 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-83a9474d-fa0e-4c66-8e10-f46dfaf81a0c tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1266 microversion: 2.1 time: 0.147834 Jan 18 20:32:39.144068 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 486/968] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:38 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:40.159692 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-8c68f764-3e8a-48fa-a30d-e11377171291 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:40.160541 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-8c68f764-3e8a-48fa-a30d-e11377171291 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:40.169348 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8c68f764-3e8a-48fa-a30d-e11377171291 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:40.169705 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8c68f764-3e8a-48fa-a30d-e11377171291 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:40.170505 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8c68f764-3e8a-48fa-a30d-e11377171291 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:40.170945 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-8c68f764-3e8a-48fa-a30d-e11377171291 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:40.305943 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-8c68f764-3e8a-48fa-a30d-e11377171291 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:40.313489 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-8c68f764-3e8a-48fa-a30d-e11377171291 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1266 microversion: 2.1 time: 0.158032 Jan 18 20:32:40.314057 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 483/969] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:40 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:41.329507 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c5679042-8123-4936-bec8-c2c7eedec0ab tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:41.330108 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c5679042-8123-4936-bec8-c2c7eedec0ab tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:41.336508 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c5679042-8123-4936-bec8-c2c7eedec0ab tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:41.336960 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c5679042-8123-4936-bec8-c2c7eedec0ab tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:41.337729 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c5679042-8123-4936-bec8-c2c7eedec0ab tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:41.338164 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c5679042-8123-4936-bec8-c2c7eedec0ab tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:41.471881 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c5679042-8123-4936-bec8-c2c7eedec0ab tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:41.479725 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c5679042-8123-4936-bec8-c2c7eedec0ab tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1266 microversion: 2.1 time: 0.153848 Jan 18 20:32:41.480728 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 487/970] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:41 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:42.496649 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b595282e-3c7b-4294-9d6a-6b3a350610aa tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:42.497220 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b595282e-3c7b-4294-9d6a-6b3a350610aa tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:42.504213 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b595282e-3c7b-4294-9d6a-6b3a350610aa tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:42.504660 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b595282e-3c7b-4294-9d6a-6b3a350610aa tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:42.505751 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b595282e-3c7b-4294-9d6a-6b3a350610aa tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:42.506186 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b595282e-3c7b-4294-9d6a-6b3a350610aa tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:42.604014 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fa207993-4bbd-4766-b7bb-b632ca326734 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1039573622", "imageRef": "c7d259ac-b206-430f-a3c0-794cee408236", "flavorRef": "452", "networks": [{"uuid": "5fa84a7d-ab69-4171-8e99-f31488e1981b"}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:32:42.639485 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b595282e-3c7b-4294-9d6a-6b3a350610aa tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:42.647457 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b595282e-3c7b-4294-9d6a-6b3a350610aa tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1266 microversion: 2.1 time: 0.154814 Jan 18 20:32:42.648059 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 484/971] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:42 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:42.654770 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-fa207993-4bbd-4766-b7bb-b632ca326734 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] validate_networks() for [('5fa84a7d-ab69-4171-8e99-f31488e1981b', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:32:42.985750 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-fa207993-4bbd-4766-b7bb-b632ca326734 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:32:42.986178 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-fa207993-4bbd-4766-b7bb-b632ca326734 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:32:42.986650 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-fa207993-4bbd-4766-b7bb-b632ca326734 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:32:42.987082 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-fa207993-4bbd-4766-b7bb-b632ca326734 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:32:42.987521 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-fa207993-4bbd-4766-b7bb-b632ca326734 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:32:42.996626 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa207993-4bbd-4766-b7bb-b632ca326734 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:42.997069 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa207993-4bbd-4766-b7bb-b632ca326734 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:42.997869 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa207993-4bbd-4766-b7bb-b632ca326734 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:42.998300 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa207993-4bbd-4766-b7bb-b632ca326734 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:43.015253 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-fa207993-4bbd-4766-b7bb-b632ca326734 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Getting quotas for project ef9b07bad78a4451b8fa6743f58e1283. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:32:43.020573 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-fa207993-4bbd-4766-b7bb-b632ca326734 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Getting quotas for user 54956be36a9d4739bb2f4f72fdd2baec and project ef9b07bad78a4451b8fa6743f58e1283. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:32:43.031387 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fa207993-4bbd-4766-b7bb-b632ca326734 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:32:43.033717 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fa207993-4bbd-4766-b7bb-b632ca326734 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c7d259ac-b206-430f-a3c0-794cee408236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:32:43.082558 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fa207993-4bbd-4766-b7bb-b632ca326734 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.482111 Jan 18 20:32:43.087065 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 488/972] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:32:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 18 20:32:43.093106 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-83f7c9ef-a0d0-4e0a-ac37-02a0e5338be9 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:43.093860 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-83f7c9ef-a0d0-4e0a-ac37-02a0e5338be9 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:43.153943 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-83f7c9ef-a0d0-4e0a-ac37-02a0e5338be9 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:43.162844 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-83f7c9ef-a0d0-4e0a-ac37-02a0e5338be9 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7" status: 200 len: 1219 microversion: 2.1 time: 0.073224 Jan 18 20:32:43.163456 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 485/973] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:43 2022] GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:43.665568 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-cbc61a88-d98b-4f7e-9186-15d728202c35 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:43.666170 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-cbc61a88-d98b-4f7e-9186-15d728202c35 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:43.673065 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cbc61a88-d98b-4f7e-9186-15d728202c35 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:43.673514 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cbc61a88-d98b-4f7e-9186-15d728202c35 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:43.674290 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cbc61a88-d98b-4f7e-9186-15d728202c35 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:43.674737 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cbc61a88-d98b-4f7e-9186-15d728202c35 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:43.805386 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-cbc61a88-d98b-4f7e-9186-15d728202c35 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:43.812822 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-cbc61a88-d98b-4f7e-9186-15d728202c35 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1266 microversion: 2.1 time: 0.151734 Jan 18 20:32:43.813315 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 489/974] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:43 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:44.180534 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a982e80b-437e-4ae1-b69c-7c5db103b01d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:44.181872 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-a982e80b-437e-4ae1-b69c-7c5db103b01d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:44.189021 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a982e80b-437e-4ae1-b69c-7c5db103b01d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:44.189473 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a982e80b-437e-4ae1-b69c-7c5db103b01d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:44.190266 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a982e80b-437e-4ae1-b69c-7c5db103b01d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:44.190733 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a982e80b-437e-4ae1-b69c-7c5db103b01d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:44.281237 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a982e80b-437e-4ae1-b69c-7c5db103b01d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:44.290647 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a982e80b-437e-4ae1-b69c-7c5db103b01d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7" status: 200 len: 1277 microversion: 2.1 time: 0.113876 Jan 18 20:32:44.291421 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 486/975] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:44 2022] GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7 => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:44.831808 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d66d8182-31a6-4b5b-aa39-fdd75f5ef5fb tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:44.832425 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d66d8182-31a6-4b5b-aa39-fdd75f5ef5fb tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:44.838525 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d66d8182-31a6-4b5b-aa39-fdd75f5ef5fb tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:44.838988 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d66d8182-31a6-4b5b-aa39-fdd75f5ef5fb tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:44.840117 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d66d8182-31a6-4b5b-aa39-fdd75f5ef5fb tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:44.840571 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d66d8182-31a6-4b5b-aa39-fdd75f5ef5fb tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:44.978085 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d66d8182-31a6-4b5b-aa39-fdd75f5ef5fb tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:44.986226 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d66d8182-31a6-4b5b-aa39-fdd75f5ef5fb tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1266 microversion: 2.1 time: 0.158070 Jan 18 20:32:44.986799 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 490/976] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:44 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:45.238923 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-fee0fa35-b029-4806-be5c-3fc78ed40452 req-e97ab5af-51f5-4f3f-b5d8-5513a3a387e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e17247-142f-411e-aa6d-fa0e6fa146d7", "tag": "7d31efc5-d65b-43da-9412-23911b521fc7"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:32:45.240463 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:32:45.240463 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:32:45.249265 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-fee0fa35-b029-4806-be5c-3fc78ed40452 req-e97ab5af-51f5-4f3f-b5d8-5513a3a387e3 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:45.250557 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-fee0fa35-b029-4806-be5c-3fc78ed40452 req-e97ab5af-51f5-4f3f-b5d8-5513a3a387e3 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:45.264584 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-fee0fa35-b029-4806-be5c-3fc78ed40452 req-e97ab5af-51f5-4f3f-b5d8-5513a3a387e3 service nova] Creating event network-changed:7d31efc5-d65b-43da-9412-23911b521fc7 for instance 92e17247-142f-411e-aa6d-fa0e6fa146d7 on hv-cinder-82160 Jan 18 20:32:45.271229 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-fee0fa35-b029-4806-be5c-3fc78ed40452 req-e97ab5af-51f5-4f3f-b5d8-5513a3a387e3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035933 Jan 18 20:32:45.272226 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 487/977] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:32:45.308955 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-667a4529-4254-439b-a1a0-4d194bbf371f tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:45.309826 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-667a4529-4254-439b-a1a0-4d194bbf371f tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:45.316484 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-667a4529-4254-439b-a1a0-4d194bbf371f tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:45.317022 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-667a4529-4254-439b-a1a0-4d194bbf371f tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:45.317887 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-667a4529-4254-439b-a1a0-4d194bbf371f tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:45.318879 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-667a4529-4254-439b-a1a0-4d194bbf371f tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:45.463576 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-667a4529-4254-439b-a1a0-4d194bbf371f tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:45.471020 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-667a4529-4254-439b-a1a0-4d194bbf371f tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7" status: 200 len: 1319 microversion: 2.1 time: 0.166306 Jan 18 20:32:45.471626 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 491/978] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:45 2022] GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:46.004349 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-d2256c18-8a12-45fd-b8a2-75a4618c2f55 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:46.005193 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-d2256c18-8a12-45fd-b8a2-75a4618c2f55 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:46.011411 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d2256c18-8a12-45fd-b8a2-75a4618c2f55 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:46.011873 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d2256c18-8a12-45fd-b8a2-75a4618c2f55 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:46.012694 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d2256c18-8a12-45fd-b8a2-75a4618c2f55 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:46.013132 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-d2256c18-8a12-45fd-b8a2-75a4618c2f55 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:46.213548 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-d2256c18-8a12-45fd-b8a2-75a4618c2f55 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:46.220931 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-d2256c18-8a12-45fd-b8a2-75a4618c2f55 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1266 microversion: 2.1 time: 0.221130 Jan 18 20:32:46.221488 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 488/979] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:45 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:46.488571 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e013a9fe-3ef1-4655-b346-c09bc0943374 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:46.489122 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e013a9fe-3ef1-4655-b346-c09bc0943374 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:46.495629 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e013a9fe-3ef1-4655-b346-c09bc0943374 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:46.496080 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e013a9fe-3ef1-4655-b346-c09bc0943374 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:46.496862 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e013a9fe-3ef1-4655-b346-c09bc0943374 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:46.497296 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e013a9fe-3ef1-4655-b346-c09bc0943374 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:46.632990 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e013a9fe-3ef1-4655-b346-c09bc0943374 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:46.640175 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e013a9fe-3ef1-4655-b346-c09bc0943374 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7" status: 200 len: 1319 microversion: 2.1 time: 0.155316 Jan 18 20:32:46.640736 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 492/980] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:46 2022] GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:47.237565 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-00b4cbf3-c4a1-4778-b9b7-7b8d0061e2dc tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:47.238146 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-00b4cbf3-c4a1-4778-b9b7-7b8d0061e2dc tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:47.244497 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-00b4cbf3-c4a1-4778-b9b7-7b8d0061e2dc tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:47.244951 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-00b4cbf3-c4a1-4778-b9b7-7b8d0061e2dc tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:47.245726 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-00b4cbf3-c4a1-4778-b9b7-7b8d0061e2dc tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:47.246160 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-00b4cbf3-c4a1-4778-b9b7-7b8d0061e2dc tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:47.384861 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-00b4cbf3-c4a1-4778-b9b7-7b8d0061e2dc tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:47.392456 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-00b4cbf3-c4a1-4778-b9b7-7b8d0061e2dc tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1266 microversion: 2.1 time: 0.158640 Jan 18 20:32:47.393225 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 489/981] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:47 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:47.422411 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-e2da909d-3fc6-46de-af49-c0209b833ca9 req-eddbc9f7-5750-4e0e-97ed-f77e4c9a41fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda8f88c-10d2-4afa-9257-97a6d029f4bf", "name": "network-vif-plugged", "status": "completed", "tag": "7d42978d-d72f-41b6-aced-e2a13e4efa4b"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:32:47.424063 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:32:47.424063 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:32:47.432673 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-e2da909d-3fc6-46de-af49-c0209b833ca9 req-eddbc9f7-5750-4e0e-97ed-f77e4c9a41fe service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:47.433146 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-e2da909d-3fc6-46de-af49-c0209b833ca9 req-eddbc9f7-5750-4e0e-97ed-f77e4c9a41fe service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:47.445376 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-e2da909d-3fc6-46de-af49-c0209b833ca9 req-eddbc9f7-5750-4e0e-97ed-f77e4c9a41fe service nova] Creating event network-vif-plugged:7d42978d-d72f-41b6-aced-e2a13e4efa4b for instance eda8f88c-10d2-4afa-9257-97a6d029f4bf on hv-cinder-82160 Jan 18 20:32:47.450372 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-e2da909d-3fc6-46de-af49-c0209b833ca9 req-eddbc9f7-5750-4e0e-97ed-f77e4c9a41fe service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031897 Jan 18 20:32:47.451233 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 493/982] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:32:47.657041 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-40d7c216-f90e-4374-b69c-6cc3949c4bbe tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:47.657658 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-40d7c216-f90e-4374-b69c-6cc3949c4bbe tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:47.664390 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-40d7c216-f90e-4374-b69c-6cc3949c4bbe tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:47.664982 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-40d7c216-f90e-4374-b69c-6cc3949c4bbe tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:47.665844 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-40d7c216-f90e-4374-b69c-6cc3949c4bbe tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:47.666409 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-40d7c216-f90e-4374-b69c-6cc3949c4bbe tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:47.810743 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-40d7c216-f90e-4374-b69c-6cc3949c4bbe tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:47.818539 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-40d7c216-f90e-4374-b69c-6cc3949c4bbe tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7" status: 200 len: 1319 microversion: 2.1 time: 0.165326 Jan 18 20:32:47.819226 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 490/983] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:47 2022] GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:48.410755 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e5834559-d35b-47c0-826f-17208cbeea7a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:48.411486 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e5834559-d35b-47c0-826f-17208cbeea7a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:48.418050 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e5834559-d35b-47c0-826f-17208cbeea7a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:48.418747 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e5834559-d35b-47c0-826f-17208cbeea7a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:48.419542 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e5834559-d35b-47c0-826f-17208cbeea7a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:48.419974 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e5834559-d35b-47c0-826f-17208cbeea7a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:48.547224 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e5834559-d35b-47c0-826f-17208cbeea7a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:48.554526 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e5834559-d35b-47c0-826f-17208cbeea7a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1266 microversion: 2.1 time: 0.148565 Jan 18 20:32:48.555109 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 494/984] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:48 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:48.834796 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7e37e582-8a60-4c61-ad05-bab85b1c230a tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:48.835444 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-7e37e582-8a60-4c61-ad05-bab85b1c230a tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:48.841690 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7e37e582-8a60-4c61-ad05-bab85b1c230a tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:48.842123 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7e37e582-8a60-4c61-ad05-bab85b1c230a tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:48.842883 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7e37e582-8a60-4c61-ad05-bab85b1c230a tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:48.843339 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7e37e582-8a60-4c61-ad05-bab85b1c230a tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:48.971280 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-7e37e582-8a60-4c61-ad05-bab85b1c230a tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:48.979282 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7e37e582-8a60-4c61-ad05-bab85b1c230a tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7" status: 200 len: 1319 microversion: 2.1 time: 0.148168 Jan 18 20:32:48.979842 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 491/985] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:48 2022] GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:49.571100 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-76171c49-ec68-4bc5-afcf-5892888a4827 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:49.571728 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-76171c49-ec68-4bc5-afcf-5892888a4827 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:49.578444 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-76171c49-ec68-4bc5-afcf-5892888a4827 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:49.578890 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-76171c49-ec68-4bc5-afcf-5892888a4827 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:49.579703 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-76171c49-ec68-4bc5-afcf-5892888a4827 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:49.580170 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-76171c49-ec68-4bc5-afcf-5892888a4827 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:49.714228 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-76171c49-ec68-4bc5-afcf-5892888a4827 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:49.721749 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-76171c49-ec68-4bc5-afcf-5892888a4827 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1454 microversion: 2.1 time: 0.154407 Jan 18 20:32:49.722397 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 495/986] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:49 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:49.738401 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-bb6fa0ed-aa7c-49a3-acc8-12c6aea0dbc2 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:49.741743 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-bb6fa0ed-aa7c-49a3-acc8-12c6aea0dbc2 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:49.747848 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bb6fa0ed-aa7c-49a3-acc8-12c6aea0dbc2 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:49.748347 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bb6fa0ed-aa7c-49a3-acc8-12c6aea0dbc2 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:49.749152 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bb6fa0ed-aa7c-49a3-acc8-12c6aea0dbc2 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:49.749589 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bb6fa0ed-aa7c-49a3-acc8-12c6aea0dbc2 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:49.893180 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-bb6fa0ed-aa7c-49a3-acc8-12c6aea0dbc2 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:49.903327 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-bb6fa0ed-aa7c-49a3-acc8-12c6aea0dbc2 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1454 microversion: 2.1 time: 0.168719 Jan 18 20:32:49.903926 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 492/987] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:49 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:49.995166 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7f541f6d-9af1-42fb-816a-3a2719852827 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:49.995778 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7f541f6d-9af1-42fb-816a-3a2719852827 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:50.003685 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7f541f6d-9af1-42fb-816a-3a2719852827 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:50.004130 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7f541f6d-9af1-42fb-816a-3a2719852827 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:50.004908 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7f541f6d-9af1-42fb-816a-3a2719852827 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:50.005335 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7f541f6d-9af1-42fb-816a-3a2719852827 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:50.140630 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7f541f6d-9af1-42fb-816a-3a2719852827 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:50.148052 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7f541f6d-9af1-42fb-816a-3a2719852827 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7" status: 200 len: 1319 microversion: 2.1 time: 0.156570 Jan 18 20:32:50.148621 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 496/988] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:49 2022] GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:51.166150 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-3ca7017a-6e56-40ad-be39-cced454c2957 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:51.166776 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-3ca7017a-6e56-40ad-be39-cced454c2957 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:51.173451 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3ca7017a-6e56-40ad-be39-cced454c2957 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:51.173901 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3ca7017a-6e56-40ad-be39-cced454c2957 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:51.174687 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3ca7017a-6e56-40ad-be39-cced454c2957 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:51.175151 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3ca7017a-6e56-40ad-be39-cced454c2957 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:51.443117 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-3ca7017a-6e56-40ad-be39-cced454c2957 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:51.451638 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-3ca7017a-6e56-40ad-be39-cced454c2957 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7" status: 200 len: 1319 microversion: 2.1 time: 0.289550 Jan 18 20:32:51.452326 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 493/989] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:51 2022] GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:51.592040 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-240d8e24-7f48-45b7-8794-c0bd12244c20 req-5080dea6-dbd7-49c0-83ee-1818735c0455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e17247-142f-411e-aa6d-fa0e6fa146d7", "name": "network-vif-plugged", "status": "completed", "tag": "7d31efc5-d65b-43da-9412-23911b521fc7"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:32:51.595070 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:32:51.595070 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:32:51.608037 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-240d8e24-7f48-45b7-8794-c0bd12244c20 req-5080dea6-dbd7-49c0-83ee-1818735c0455 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:51.608859 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-240d8e24-7f48-45b7-8794-c0bd12244c20 req-5080dea6-dbd7-49c0-83ee-1818735c0455 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:51.630938 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-240d8e24-7f48-45b7-8794-c0bd12244c20 req-5080dea6-dbd7-49c0-83ee-1818735c0455 service nova] Creating event network-vif-plugged:7d31efc5-d65b-43da-9412-23911b521fc7 for instance 92e17247-142f-411e-aa6d-fa0e6fa146d7 on hv-cinder-82160 Jan 18 20:32:51.638967 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-240d8e24-7f48-45b7-8794-c0bd12244c20 req-5080dea6-dbd7-49c0-83ee-1818735c0455 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054344 Jan 18 20:32:51.639965 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 497/990] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:32:51.771817 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-951ac9d1-a6a6-4561-9bea-57cfa6539220 req-c9313b18-64bd-481f-9b8f-3bb8f57b06dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda8f88c-10d2-4afa-9257-97a6d029f4bf", "tag": "7d42978d-d72f-41b6-aced-e2a13e4efa4b"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:32:51.773695 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:32:51.773695 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:32:51.781210 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-951ac9d1-a6a6-4561-9bea-57cfa6539220 req-c9313b18-64bd-481f-9b8f-3bb8f57b06dc service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:51.781743 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-951ac9d1-a6a6-4561-9bea-57cfa6539220 req-c9313b18-64bd-481f-9b8f-3bb8f57b06dc service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:51.793708 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-951ac9d1-a6a6-4561-9bea-57cfa6539220 req-c9313b18-64bd-481f-9b8f-3bb8f57b06dc service nova] Creating event network-changed:7d42978d-d72f-41b6-aced-e2a13e4efa4b for instance eda8f88c-10d2-4afa-9257-97a6d029f4bf on hv-cinder-82160 Jan 18 20:32:51.799009 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-951ac9d1-a6a6-4561-9bea-57cfa6539220 req-c9313b18-64bd-481f-9b8f-3bb8f57b06dc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032049 Jan 18 20:32:51.799644 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 494/991] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:32:52.469708 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5258f627-af0b-4411-acf0-329fef820c67 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:52.471358 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5258f627-af0b-4411-acf0-329fef820c67 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:52.478543 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5258f627-af0b-4411-acf0-329fef820c67 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:52.478996 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5258f627-af0b-4411-acf0-329fef820c67 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:52.479827 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5258f627-af0b-4411-acf0-329fef820c67 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:52.480262 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5258f627-af0b-4411-acf0-329fef820c67 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:52.619429 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5258f627-af0b-4411-acf0-329fef820c67 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:52.626977 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5258f627-af0b-4411-acf0-329fef820c67 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7" status: 200 len: 1319 microversion: 2.1 time: 0.161206 Jan 18 20:32:52.627586 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 498/992] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:52 2022] GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:53.644947 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-4facc075-556c-4d53-aaf8-38d96686c91e tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:32:53.645653 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-4facc075-556c-4d53-aaf8-38d96686c91e tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:53.651810 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4facc075-556c-4d53-aaf8-38d96686c91e tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:53.652256 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4facc075-556c-4d53-aaf8-38d96686c91e tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:53.653032 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4facc075-556c-4d53-aaf8-38d96686c91e tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:53.653469 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-4facc075-556c-4d53-aaf8-38d96686c91e tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:53.779942 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-4facc075-556c-4d53-aaf8-38d96686c91e tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:32:53.787743 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-4facc075-556c-4d53-aaf8-38d96686c91e tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7" status: 200 len: 1508 microversion: 2.1 time: 0.147296 Jan 18 20:32:53.788305 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 495/993] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:32:53 2022] GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:32:53.804727 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bfbf8859-af99-42d2-9500-3b817aa91b6d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4e9933d-5d63-4053-b689-cc1da5631ffd", "device": "/dev/sdb"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:32:53.805847 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bfbf8859-af99-42d2-9500-3b817aa91b6d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:32:53.812144 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bfbf8859-af99-42d2-9500-3b817aa91b6d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:53.812585 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bfbf8859-af99-42d2-9500-3b817aa91b6d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:53.813352 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bfbf8859-af99-42d2-9500-3b817aa91b6d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:32:53.813814 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bfbf8859-af99-42d2-9500-3b817aa91b6d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:32:54.038898 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bfbf8859-af99-42d2-9500-3b817aa91b6d tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "POST /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.238404 Jan 18 20:32:54.039524 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 499/994] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Jan 18 20:32:53 2022] POST /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7/os-volume_attachments => generated 194 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:33:12.200484 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-bc4ab5fc-88be-4496-844e-632a1a7157fa tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:33:12.200975 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-bc4ab5fc-88be-4496-844e-632a1a7157fa tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:33:12.207683 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bc4ab5fc-88be-4496-844e-632a1a7157fa tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:33:12.208129 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bc4ab5fc-88be-4496-844e-632a1a7157fa tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:33:12.208902 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bc4ab5fc-88be-4496-844e-632a1a7157fa tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:33:12.209331 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-bc4ab5fc-88be-4496-844e-632a1a7157fa tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:33:12.285187 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.objects.instance [None req-bc4ab5fc-88be-4496-844e-632a1a7157fa tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lazy-loading 'services' on Instance uuid 92e17247-142f-411e-aa6d-fa0e6fa146d7 {{(pid=116376) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:33:12.356079 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-bc4ab5fc-88be-4496-844e-632a1a7157fa tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "DELETE /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7/os-volume_attachments/f4e9933d-5d63-4053-b689-cc1da5631ffd" status: 202 len: 0 microversion: 2.1 time: 0.159045 Jan 18 20:33:12.356588 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 496/995] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Jan 18 20:33:12 2022] DELETE /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7/os-volume_attachments/f4e9933d-5d63-4053-b689-cc1da5631ffd => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:33:13.465743 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ad1cad14-bd97-4fc3-ad87-7e06c2cd2255 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:33:13.466301 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ad1cad14-bd97-4fc3-ad87-7e06c2cd2255 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:33:13.472411 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ad1cad14-bd97-4fc3-ad87-7e06c2cd2255 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:33:13.472844 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ad1cad14-bd97-4fc3-ad87-7e06c2cd2255 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:33:13.473604 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ad1cad14-bd97-4fc3-ad87-7e06c2cd2255 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:33:13.474031 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ad1cad14-bd97-4fc3-ad87-7e06c2cd2255 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:33:13.498767 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ad1cad14-bd97-4fc3-ad87-7e06c2cd2255 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:33:13.575253 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ad1cad14-bd97-4fc3-ad87-7e06c2cd2255 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "DELETE /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7" status: 204 len: 0 microversion: 2.1 time: 0.113340 Jan 18 20:33:13.575965 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 500/996] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:33:13 2022] DELETE /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:33:13.586249 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-503b49cc-40ee-4090-b2b2-22a71bc915e6 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:33:13.587109 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-503b49cc-40ee-4090-b2b2-22a71bc915e6 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:33:13.593292 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-503b49cc-40ee-4090-b2b2-22a71bc915e6 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:33:13.593740 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-503b49cc-40ee-4090-b2b2-22a71bc915e6 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:33:13.594520 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-503b49cc-40ee-4090-b2b2-22a71bc915e6 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:33:13.594951 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-503b49cc-40ee-4090-b2b2-22a71bc915e6 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:33:13.720397 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-503b49cc-40ee-4090-b2b2-22a71bc915e6 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:33:13.727732 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-503b49cc-40ee-4090-b2b2-22a71bc915e6 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7" status: 200 len: 1514 microversion: 2.1 time: 0.146866 Jan 18 20:33:13.728937 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 497/997] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:33:13 2022] GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:33:14.745049 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f0c4a526-3a95-42f8-bfcc-22639d06fdf7 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:33:14.745753 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f0c4a526-3a95-42f8-bfcc-22639d06fdf7 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:33:14.752016 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f0c4a526-3a95-42f8-bfcc-22639d06fdf7 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:33:14.752467 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f0c4a526-3a95-42f8-bfcc-22639d06fdf7 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:33:14.753742 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f0c4a526-3a95-42f8-bfcc-22639d06fdf7 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:33:14.754179 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f0c4a526-3a95-42f8-bfcc-22639d06fdf7 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:33:14.885216 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f0c4a526-3a95-42f8-bfcc-22639d06fdf7 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:33:14.892702 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f0c4a526-3a95-42f8-bfcc-22639d06fdf7 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7" status: 200 len: 1514 microversion: 2.1 time: 0.151715 Jan 18 20:33:14.893268 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 501/998] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:33:14 2022] GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:33:15.774106 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-205a9d9e-bc7a-44a1-bc05-3c62748631cb req-6b2ea5ba-0fab-4479-a961-d850dcbe94be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e17247-142f-411e-aa6d-fa0e6fa146d7", "name": "network-vif-deleted", "tag": "7d31efc5-d65b-43da-9412-23911b521fc7"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:33:15.775760 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:33:15.775760 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:33:15.783815 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-205a9d9e-bc7a-44a1-bc05-3c62748631cb req-6b2ea5ba-0fab-4479-a961-d850dcbe94be service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:33:15.784338 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-205a9d9e-bc7a-44a1-bc05-3c62748631cb req-6b2ea5ba-0fab-4479-a961-d850dcbe94be service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:33:15.795891 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-205a9d9e-bc7a-44a1-bc05-3c62748631cb req-6b2ea5ba-0fab-4479-a961-d850dcbe94be service nova] Creating event network-vif-deleted:7d31efc5-d65b-43da-9412-23911b521fc7 for instance 92e17247-142f-411e-aa6d-fa0e6fa146d7 on hv-cinder-82160 Jan 18 20:33:15.801329 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-205a9d9e-bc7a-44a1-bc05-3c62748631cb req-6b2ea5ba-0fab-4479-a961-d850dcbe94be service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030912 Jan 18 20:33:15.802004 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 498/999] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:33:15.909322 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6d325842-d5eb-4b05-8415-c981452feb23 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:33:15.909906 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6d325842-d5eb-4b05-8415-c981452feb23 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:33:15.916515 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6d325842-d5eb-4b05-8415-c981452feb23 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:33:15.917166 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6d325842-d5eb-4b05-8415-c981452feb23 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:33:15.918275 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6d325842-d5eb-4b05-8415-c981452feb23 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:33:15.918699 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6d325842-d5eb-4b05-8415-c981452feb23 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:33:15.950146 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6d325842-d5eb-4b05-8415-c981452feb23 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:33:15.950488 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6d325842-d5eb-4b05-8415-c981452feb23 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:33:15.950928 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-6d325842-d5eb-4b05-8415-c981452feb23 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lazy-loading 'fault' on Instance uuid 92e17247-142f-411e-aa6d-fa0e6fa146d7 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:33:15.990622 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6d325842-d5eb-4b05-8415-c981452feb23 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54956be36a9d4739bb2f4f72fdd2baec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9b07bad78a4451b8fa6743f58e1283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:33:15.998038 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6d325842-d5eb-4b05-8415-c981452feb23 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7" status: 200 len: 1309 microversion: 2.1 time: 0.092357 Jan 18 20:33:15.998610 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 502/1000] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:33:15 2022] GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:33:17.016736 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-33635c7b-4cb1-49fe-9a39-787ebd2b0d81 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:33:17.017494 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-33635c7b-4cb1-49fe-9a39-787ebd2b0d81 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] [instance: 92e17247-142f-411e-aa6d-fa0e6fa146d7] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:33:17.024594 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-33635c7b-4cb1-49fe-9a39-787ebd2b0d81 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:33:17.025108 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-33635c7b-4cb1-49fe-9a39-787ebd2b0d81 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:33:17.026158 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-33635c7b-4cb1-49fe-9a39-787ebd2b0d81 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:33:17.026945 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-33635c7b-4cb1-49fe-9a39-787ebd2b0d81 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:33:17.042013 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-33635c7b-4cb1-49fe-9a39-787ebd2b0d81 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] HTTP exception thrown: Instance 92e17247-142f-411e-aa6d-fa0e6fa146d7 could not be found. Jan 18 20:33:17.042600 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-33635c7b-4cb1-49fe-9a39-787ebd2b0d81 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] Returning 404 to user: Instance 92e17247-142f-411e-aa6d-fa0e6fa146d7 could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:33:17.043720 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-33635c7b-4cb1-49fe-9a39-787ebd2b0d81 tempest-VolumesSnapshotTestJSON-677432041 tempest-VolumesSnapshotTestJSON-677432041-project] 10.222.0.67 "GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7" status: 404 len: 111 microversion: 2.1 time: 0.031479 Jan 18 20:33:17.044264 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 499/1001] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:33:17 2022] GET /compute/v2.1/servers/92e17247-142f-411e-aa6d-fa0e6fa146d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:33:58.912553 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fa4df6a5-50a9-41bf-8117-1605738277af tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Action: 'create', calling method: .version_select at 0x7f1782dfc4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1691686529"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:33:58.926591 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-fa4df6a5-50a9-41bf-8117-1605738277af tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Getting quotas for project fdf494b30e744b9d83b873fae342275f. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:33:58.930364 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-fa4df6a5-50a9-41bf-8117-1605738277af tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Getting quotas for user 94873063908142a59d23fdcbb44b1376 and project fdf494b30e744b9d83b873fae342275f. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:33:58.942211 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fa4df6a5-50a9-41bf-8117-1605738277af tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [39bc3590-5c56-479f-97da-455d45f511a3] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 18 20:33:59.951086 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO oslo.messaging._drivers.impl_rabbit [None req-fa4df6a5-50a9-41bf-8117-1605738277af tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [39bc3590-5c56-479f-97da-455d45f511a3] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 44266. Jan 18 20:34:00.174833 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-fa4df6a5-50a9-41bf-8117-1605738277af tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Getting quotas for project fdf494b30e744b9d83b873fae342275f. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:34:00.179929 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-fa4df6a5-50a9-41bf-8117-1605738277af tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Getting quotas for user 94873063908142a59d23fdcbb44b1376 and project fdf494b30e744b9d83b873fae342275f. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:34:00.194232 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fa4df6a5-50a9-41bf-8117-1605738277af tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 1.286177 Jan 18 20:34:00.194841 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 503/1002] 10.222.0.67 () {60 vars in 1157 bytes} [Tue Jan 18 20:33:58 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:34:00.243109 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-9b782a1d-9d1b-4f74-adc8-4748c30df4ce tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1018673505", "imageRef": "d40ca5ed-e546-4bfb-a143-b7c0517286af", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1691686529", "networks": [{"uuid": "8272cfcc-5091-400a-b3e6-3ea1969e620b"}]}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:34:00.398235 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.network.neutron [None req-9b782a1d-9d1b-4f74-adc8-4748c30df4ce tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] validate_networks() for [('8272cfcc-5091-400a-b3e6-3ea1969e620b', None, None, None, None, None)] {{(pid=116376) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:34:00.764020 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-9b782a1d-9d1b-4f74-adc8-4748c30df4ce tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Flavor limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:34:00.764467 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-9b782a1d-9d1b-4f74-adc8-4748c30df4ce tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Image limits 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:34:00.764941 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-9b782a1d-9d1b-4f74-adc8-4748c30df4ce tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Flavor pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:34:00.765343 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-9b782a1d-9d1b-4f74-adc8-4748c30df4ce tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Image pref 0:0:0 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:34:00.765793 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.virt.hardware [None req-9b782a1d-9d1b-4f74-adc8-4748c30df4ce tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116376) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:34:00.775259 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9b782a1d-9d1b-4f74-adc8-4748c30df4ce tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:00.775708 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9b782a1d-9d1b-4f74-adc8-4748c30df4ce tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:00.776519 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9b782a1d-9d1b-4f74-adc8-4748c30df4ce tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:00.776953 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-9b782a1d-9d1b-4f74-adc8-4748c30df4ce tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:00.792816 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-9b782a1d-9d1b-4f74-adc8-4748c30df4ce tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Getting quotas for project fdf494b30e744b9d83b873fae342275f. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:34:00.796966 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.quota [None req-9b782a1d-9d1b-4f74-adc8-4748c30df4ce tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Getting quotas for user 94873063908142a59d23fdcbb44b1376 and project fdf494b30e744b9d83b873fae342275f. Resources: {'cores', 'ram', 'instances'} {{(pid=116376) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:34:00.808062 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-9b782a1d-9d1b-4f74-adc8-4748c30df4ce tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Going to run 1 instances... {{(pid=116376) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:34:00.810304 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-9b782a1d-9d1b-4f74-adc8-4748c30df4ce tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d40ca5ed-e546-4bfb-a143-b7c0517286af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116376) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:34:00.857945 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-9b782a1d-9d1b-4f74-adc8-4748c30df4ce tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618633 Jan 18 20:34:00.858904 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 500/1003] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:34:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 20:34:00.871291 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bcf4db05-336a-4576-a766-5f726ee57648 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:00.872230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bcf4db05-336a-4576-a766-5f726ee57648 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:01.025737 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bcf4db05-336a-4576-a766-5f726ee57648 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:01.032298 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bcf4db05-336a-4576-a766-5f726ee57648 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1259 microversion: 2.1 time: 0.166098 Jan 18 20:34:01.032857 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 504/1004] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:00 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:02.050059 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0fa7521f-1f2d-42b9-ad50-ec6cff052111 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:02.050678 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0fa7521f-1f2d-42b9-ad50-ec6cff052111 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:02.056990 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0fa7521f-1f2d-42b9-ad50-ec6cff052111 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:02.057447 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0fa7521f-1f2d-42b9-ad50-ec6cff052111 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:02.058229 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0fa7521f-1f2d-42b9-ad50-ec6cff052111 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:02.058666 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0fa7521f-1f2d-42b9-ad50-ec6cff052111 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:02.119900 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-0fa7521f-1f2d-42b9-ad50-ec6cff052111 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:02.128722 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0fa7521f-1f2d-42b9-ad50-ec6cff052111 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1317 microversion: 2.1 time: 0.082804 Jan 18 20:34:02.129537 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 501/1005] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:02 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1317 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:03.146435 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8b06ba8b-6e3b-468c-8bba-d7388b90ce5c tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:03.147850 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8b06ba8b-6e3b-468c-8bba-d7388b90ce5c tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:03.156545 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8b06ba8b-6e3b-468c-8bba-d7388b90ce5c tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:03.157469 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8b06ba8b-6e3b-468c-8bba-d7388b90ce5c tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:03.159051 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8b06ba8b-6e3b-468c-8bba-d7388b90ce5c tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:03.159051 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8b06ba8b-6e3b-468c-8bba-d7388b90ce5c tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:03.300001 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8b06ba8b-6e3b-468c-8bba-d7388b90ce5c tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:03.308509 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8b06ba8b-6e3b-468c-8bba-d7388b90ce5c tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1359 microversion: 2.1 time: 0.166508 Jan 18 20:34:03.309247 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 505/1006] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:03 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:04.327417 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7768e8df-d659-490a-abfc-875bf49d8040 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:04.328244 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-7768e8df-d659-490a-abfc-875bf49d8040 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:04.336644 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7768e8df-d659-490a-abfc-875bf49d8040 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:04.337094 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7768e8df-d659-490a-abfc-875bf49d8040 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:04.337968 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7768e8df-d659-490a-abfc-875bf49d8040 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:04.338399 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7768e8df-d659-490a-abfc-875bf49d8040 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:04.478432 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-7768e8df-d659-490a-abfc-875bf49d8040 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:04.486813 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7768e8df-d659-490a-abfc-875bf49d8040 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1359 microversion: 2.1 time: 0.164803 Jan 18 20:34:04.487420 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 502/1007] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:04 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:05.505179 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5a7aae76-21c7-419c-ad76-28393f6c5c66 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:05.506061 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5a7aae76-21c7-419c-ad76-28393f6c5c66 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:05.513372 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a7aae76-21c7-419c-ad76-28393f6c5c66 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:05.514090 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a7aae76-21c7-419c-ad76-28393f6c5c66 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:05.514940 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a7aae76-21c7-419c-ad76-28393f6c5c66 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:05.515404 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a7aae76-21c7-419c-ad76-28393f6c5c66 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:05.672409 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5a7aae76-21c7-419c-ad76-28393f6c5c66 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:05.679706 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5a7aae76-21c7-419c-ad76-28393f6c5c66 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1359 microversion: 2.1 time: 0.179851 Jan 18 20:34:05.680273 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 506/1008] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:05 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:06.696697 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-993f1325-34e0-459c-ad08-0480cd998f25 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:06.698386 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-993f1325-34e0-459c-ad08-0480cd998f25 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:06.706146 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-993f1325-34e0-459c-ad08-0480cd998f25 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:06.707181 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-993f1325-34e0-459c-ad08-0480cd998f25 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:06.708724 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-993f1325-34e0-459c-ad08-0480cd998f25 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:06.709321 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-993f1325-34e0-459c-ad08-0480cd998f25 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:06.851734 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-993f1325-34e0-459c-ad08-0480cd998f25 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:06.859295 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-993f1325-34e0-459c-ad08-0480cd998f25 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1359 microversion: 2.1 time: 0.166449 Jan 18 20:34:06.860112 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 503/1009] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:06 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:07.876525 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e99dc210-9ec4-42af-be13-8dd1dca16ab9 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:07.877156 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e99dc210-9ec4-42af-be13-8dd1dca16ab9 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:07.884687 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e99dc210-9ec4-42af-be13-8dd1dca16ab9 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:07.885169 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e99dc210-9ec4-42af-be13-8dd1dca16ab9 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:07.885992 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e99dc210-9ec4-42af-be13-8dd1dca16ab9 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:07.886416 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e99dc210-9ec4-42af-be13-8dd1dca16ab9 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:08.032755 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e99dc210-9ec4-42af-be13-8dd1dca16ab9 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:08.041689 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e99dc210-9ec4-42af-be13-8dd1dca16ab9 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1359 microversion: 2.1 time: 0.168928 Jan 18 20:34:08.042389 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 507/1010] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:07 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:09.059458 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-85a4cbb7-d1dd-4872-8404-104cae3604f4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:09.060222 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-85a4cbb7-d1dd-4872-8404-104cae3604f4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:09.066447 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-85a4cbb7-d1dd-4872-8404-104cae3604f4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:09.066919 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-85a4cbb7-d1dd-4872-8404-104cae3604f4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:09.067738 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-85a4cbb7-d1dd-4872-8404-104cae3604f4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:09.068180 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-85a4cbb7-d1dd-4872-8404-104cae3604f4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:09.212197 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-85a4cbb7-d1dd-4872-8404-104cae3604f4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:09.220408 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-85a4cbb7-d1dd-4872-8404-104cae3604f4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1359 microversion: 2.1 time: 0.164480 Jan 18 20:34:09.221481 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 504/1011] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:09 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:10.238646 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-67eacaa2-fd37-4451-a1fc-f9ac7cc54e3d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:10.239874 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-67eacaa2-fd37-4451-a1fc-f9ac7cc54e3d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:10.246141 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67eacaa2-fd37-4451-a1fc-f9ac7cc54e3d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:10.246590 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67eacaa2-fd37-4451-a1fc-f9ac7cc54e3d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:10.247461 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67eacaa2-fd37-4451-a1fc-f9ac7cc54e3d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:10.247899 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67eacaa2-fd37-4451-a1fc-f9ac7cc54e3d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:10.381586 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-67eacaa2-fd37-4451-a1fc-f9ac7cc54e3d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:10.389011 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-67eacaa2-fd37-4451-a1fc-f9ac7cc54e3d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1359 microversion: 2.1 time: 0.154227 Jan 18 20:34:10.389578 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 508/1012] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:10 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:11.044910 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-2ef7b928-2cfc-4272-9fb2-628da77d845a req-02213950-d8fb-435a-93e9-380aaa2c9d06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2293f505-4950-4219-ae01-fa3597af3e90", "tag": "d913cdd2-3b97-4121-9ee9-3e3d66339724"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:34:11.046530 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:34:11.046530 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:34:11.057022 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-2ef7b928-2cfc-4272-9fb2-628da77d845a req-02213950-d8fb-435a-93e9-380aaa2c9d06 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:11.058628 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-2ef7b928-2cfc-4272-9fb2-628da77d845a req-02213950-d8fb-435a-93e9-380aaa2c9d06 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:11.080895 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-2ef7b928-2cfc-4272-9fb2-628da77d845a req-02213950-d8fb-435a-93e9-380aaa2c9d06 service nova] Creating event network-changed:d913cdd2-3b97-4121-9ee9-3e3d66339724 for instance 2293f505-4950-4219-ae01-fa3597af3e90 on hv-cinder-82160 Jan 18 20:34:11.086681 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-2ef7b928-2cfc-4272-9fb2-628da77d845a req-02213950-d8fb-435a-93e9-380aaa2c9d06 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045570 Jan 18 20:34:11.087249 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 505/1013] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:34:11.405520 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3569f937-e7e7-4d70-95df-801ab8a489b7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:11.406224 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3569f937-e7e7-4d70-95df-801ab8a489b7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:11.412538 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3569f937-e7e7-4d70-95df-801ab8a489b7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:11.413046 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3569f937-e7e7-4d70-95df-801ab8a489b7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:11.413834 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3569f937-e7e7-4d70-95df-801ab8a489b7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:11.414271 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3569f937-e7e7-4d70-95df-801ab8a489b7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:11.583836 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3569f937-e7e7-4d70-95df-801ab8a489b7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:11.591367 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3569f937-e7e7-4d70-95df-801ab8a489b7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1359 microversion: 2.1 time: 0.189452 Jan 18 20:34:11.591941 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 509/1014] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:11 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:12.609166 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-3d9eeb09-1d2e-457a-89c9-0b4867011c47 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:12.609829 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-3d9eeb09-1d2e-457a-89c9-0b4867011c47 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:12.616022 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3d9eeb09-1d2e-457a-89c9-0b4867011c47 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:12.616473 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3d9eeb09-1d2e-457a-89c9-0b4867011c47 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:12.617248 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3d9eeb09-1d2e-457a-89c9-0b4867011c47 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:12.617690 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-3d9eeb09-1d2e-457a-89c9-0b4867011c47 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:12.746836 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-3d9eeb09-1d2e-457a-89c9-0b4867011c47 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:12.755021 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-3d9eeb09-1d2e-457a-89c9-0b4867011c47 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1359 microversion: 2.1 time: 0.149984 Jan 18 20:34:12.755630 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 506/1015] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:12 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:13.771882 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-79382726-2815-4da8-82fd-a1708861685b tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:13.772491 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-79382726-2815-4da8-82fd-a1708861685b tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:13.778752 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-79382726-2815-4da8-82fd-a1708861685b tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:13.779264 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-79382726-2815-4da8-82fd-a1708861685b tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:13.780049 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-79382726-2815-4da8-82fd-a1708861685b tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:13.780491 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-79382726-2815-4da8-82fd-a1708861685b tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:13.912186 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-79382726-2815-4da8-82fd-a1708861685b tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:13.919734 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-79382726-2815-4da8-82fd-a1708861685b tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1359 microversion: 2.1 time: 0.151303 Jan 18 20:34:13.920299 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 510/1016] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:13 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:14.937169 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-f67823dc-c6ce-4c78-8b8f-56bec604b3b0 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:14.937743 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-f67823dc-c6ce-4c78-8b8f-56bec604b3b0 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:14.944799 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f67823dc-c6ce-4c78-8b8f-56bec604b3b0 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:14.945241 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f67823dc-c6ce-4c78-8b8f-56bec604b3b0 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:14.946011 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f67823dc-c6ce-4c78-8b8f-56bec604b3b0 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:14.946441 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-f67823dc-c6ce-4c78-8b8f-56bec604b3b0 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:15.073653 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-f67823dc-c6ce-4c78-8b8f-56bec604b3b0 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:15.081071 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-f67823dc-c6ce-4c78-8b8f-56bec604b3b0 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1359 microversion: 2.1 time: 0.147530 Jan 18 20:34:15.082072 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 507/1017] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:14 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:15.972841 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-80fc3ffd-553f-46a5-8f90-278804b2ce00 req-75b2be71-fba5-473e-9613-4ddab1337601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2293f505-4950-4219-ae01-fa3597af3e90", "name": "network-vif-plugged", "status": "completed", "tag": "d913cdd2-3b97-4121-9ee9-3e3d66339724"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:34:15.974997 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:34:15.974997 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:34:15.982598 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-80fc3ffd-553f-46a5-8f90-278804b2ce00 req-75b2be71-fba5-473e-9613-4ddab1337601 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:15.983058 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-80fc3ffd-553f-46a5-8f90-278804b2ce00 req-75b2be71-fba5-473e-9613-4ddab1337601 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:15.994666 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-80fc3ffd-553f-46a5-8f90-278804b2ce00 req-75b2be71-fba5-473e-9613-4ddab1337601 service nova] Creating event network-vif-plugged:d913cdd2-3b97-4121-9ee9-3e3d66339724 for instance 2293f505-4950-4219-ae01-fa3597af3e90 on hv-cinder-82160 Jan 18 20:34:15.999936 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-80fc3ffd-553f-46a5-8f90-278804b2ce00 req-75b2be71-fba5-473e-9613-4ddab1337601 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090489 Jan 18 20:34:16.000468 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 511/1018] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:34:16.097609 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-defc8d93-ee55-4260-a083-a334e28e0140 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:16.098210 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-defc8d93-ee55-4260-a083-a334e28e0140 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:16.104665 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-defc8d93-ee55-4260-a083-a334e28e0140 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:16.105117 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-defc8d93-ee55-4260-a083-a334e28e0140 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:16.105899 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-defc8d93-ee55-4260-a083-a334e28e0140 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:16.106338 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-defc8d93-ee55-4260-a083-a334e28e0140 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:16.247586 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-defc8d93-ee55-4260-a083-a334e28e0140 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:16.254815 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-defc8d93-ee55-4260-a083-a334e28e0140 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1359 microversion: 2.1 time: 0.160861 Jan 18 20:34:16.255349 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 508/1019] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:16 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:17.272036 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0f3aecaa-7cca-48dd-9b6c-d4c7aeeeaaa4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:17.272723 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0f3aecaa-7cca-48dd-9b6c-d4c7aeeeaaa4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:17.279420 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0f3aecaa-7cca-48dd-9b6c-d4c7aeeeaaa4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:17.279871 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0f3aecaa-7cca-48dd-9b6c-d4c7aeeeaaa4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:17.280643 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0f3aecaa-7cca-48dd-9b6c-d4c7aeeeaaa4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:17.281077 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0f3aecaa-7cca-48dd-9b6c-d4c7aeeeaaa4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:17.415195 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0f3aecaa-7cca-48dd-9b6c-d4c7aeeeaaa4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:17.422649 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0f3aecaa-7cca-48dd-9b6c-d4c7aeeeaaa4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1550 microversion: 2.1 time: 0.155308 Jan 18 20:34:17.423246 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 512/1020] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:17 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:17.438875 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7aca273a-f7f7-4de3-b52b-7860545073f3 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:17.439523 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-7aca273a-f7f7-4de3-b52b-7860545073f3 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:17.446382 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7aca273a-f7f7-4de3-b52b-7860545073f3 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:17.446828 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7aca273a-f7f7-4de3-b52b-7860545073f3 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:17.447639 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7aca273a-f7f7-4de3-b52b-7860545073f3 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:17.448073 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7aca273a-f7f7-4de3-b52b-7860545073f3 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:17.573338 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-7aca273a-f7f7-4de3-b52b-7860545073f3 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:17.580885 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7aca273a-f7f7-4de3-b52b-7860545073f3 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1550 microversion: 2.1 time: 0.145617 Jan 18 20:34:17.581446 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 509/1021] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:17 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1550 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:17.596172 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6cdef3d6-ecb6-4bf1-80ad-f2c8c31f66cf tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:17.599483 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:34:17.599483 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:34:17.600467 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6cdef3d6-ecb6-4bf1-80ad-f2c8c31f66cf tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:17.601205 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6cdef3d6-ecb6-4bf1-80ad-f2c8c31f66cf tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Searching by: {'deleted': False, 'project_id': 'fdf494b30e744b9d83b873fae342275f'} {{(pid=116375) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 18 20:34:17.607725 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6cdef3d6-ecb6-4bf1-80ad-f2c8c31f66cf tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:17.608167 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6cdef3d6-ecb6-4bf1-80ad-f2c8c31f66cf tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:17.608971 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6cdef3d6-ecb6-4bf1-80ad-f2c8c31f66cf tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:17.609402 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6cdef3d6-ecb6-4bf1-80ad-f2c8c31f66cf tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:17.702441 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.multi_cell_list [None req-6cdef3d6-ecb6-4bf1-80ad-f2c8c31f66cf tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116375) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 18 20:34:17.795847 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6cdef3d6-ecb6-4bf1-80ad-f2c8c31f66cf tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203145 Jan 18 20:34:17.796428 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 513/1022] 10.222.0.67 () {58 vars in 1124 bytes} [Tue Jan 18 20:34:17 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:34:17.806865 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-a9a8f927-7963-4d35-9227-1b97013315d4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:17.807513 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-a9a8f927-7963-4d35-9227-1b97013315d4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:17.813435 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a9a8f927-7963-4d35-9227-1b97013315d4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:17.813883 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a9a8f927-7963-4d35-9227-1b97013315d4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:17.814663 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a9a8f927-7963-4d35-9227-1b97013315d4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:17.815128 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-a9a8f927-7963-4d35-9227-1b97013315d4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:17.940656 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-a9a8f927-7963-4d35-9227-1b97013315d4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:17.948273 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-a9a8f927-7963-4d35-9227-1b97013315d4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1550 microversion: 2.1 time: 0.145051 Jan 18 20:34:17.948844 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 510/1023] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:17 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1550 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:34:19.437689 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bcc0a15a-eda1-4de6-9c8d-51cdb90dd1f1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b444b82-8a56-4040-8ad6-19c57f749dc8"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:34:19.438739 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bcc0a15a-eda1-4de6-9c8d-51cdb90dd1f1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:19.445536 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bcc0a15a-eda1-4de6-9c8d-51cdb90dd1f1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:19.445989 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bcc0a15a-eda1-4de6-9c8d-51cdb90dd1f1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:19.446773 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bcc0a15a-eda1-4de6-9c8d-51cdb90dd1f1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:19.447247 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bcc0a15a-eda1-4de6-9c8d-51cdb90dd1f1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:19.702926 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bcc0a15a-eda1-4de6-9c8d-51cdb90dd1f1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "POST /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268636 Jan 18 20:34:19.703583 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 514/1024] 10.222.0.67 () {60 vars in 1322 bytes} [Tue Jan 18 20:34:19 2022] POST /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:34:26.166501 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-b18097c8-96e2-40b6-be04-efca5771b588 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:26.167139 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-b18097c8-96e2-40b6-be04-efca5771b588 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:26.173401 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b18097c8-96e2-40b6-be04-efca5771b588 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:26.173851 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b18097c8-96e2-40b6-be04-efca5771b588 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:26.174628 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b18097c8-96e2-40b6-be04-efca5771b588 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:26.175096 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-b18097c8-96e2-40b6-be04-efca5771b588 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:26.314390 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-b18097c8-96e2-40b6-be04-efca5771b588 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:26.322536 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-b18097c8-96e2-40b6-be04-efca5771b588 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1596 microversion: 2.1 time: 0.159945 Jan 18 20:34:26.323176 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 511/1025] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:26 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1596 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:28.000036 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-03ab56b3-20d6-4ce8-abce-7face4f7659c req-20b84946-c133-4935-a5a4-0a9ddaa541f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2293f505-4950-4219-ae01-fa3597af3e90", "tag": "d913cdd2-3b97-4121-9ee9-3e3d66339724"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:34:28.001735 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:34:28.001735 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:34:28.010242 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-03ab56b3-20d6-4ce8-abce-7face4f7659c req-20b84946-c133-4935-a5a4-0a9ddaa541f3 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:28.010774 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-03ab56b3-20d6-4ce8-abce-7face4f7659c req-20b84946-c133-4935-a5a4-0a9ddaa541f3 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:28.023224 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-03ab56b3-20d6-4ce8-abce-7face4f7659c req-20b84946-c133-4935-a5a4-0a9ddaa541f3 service nova] Creating event network-changed:d913cdd2-3b97-4121-9ee9-3e3d66339724 for instance 2293f505-4950-4219-ae01-fa3597af3e90 on hv-cinder-82160 Jan 18 20:34:28.028825 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-03ab56b3-20d6-4ce8-abce-7face4f7659c req-20b84946-c133-4935-a5a4-0a9ddaa541f3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091160 Jan 18 20:34:28.030146 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 515/1026] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:34:29.015856 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-602c1943-d897-4093-b239-060410ac8235 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1510748836"}} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:34:29.016399 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-602c1943-d897-4093-b239-060410ac8235 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:29.023398 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-602c1943-d897-4093-b239-060410ac8235 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:29.023847 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-602c1943-d897-4093-b239-060410ac8235 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:29.024636 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-602c1943-d897-4093-b239-060410ac8235 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:29.025069 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-602c1943-d897-4093-b239-060410ac8235 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:29.156272 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.network.security_group_api [None req-602c1943-d897-4093-b239-060410ac8235 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Adding security group 03cb478f-d5bc-4e2d-8994-c7a140e4aa06 to port d913cdd2-3b97-4121-9ee9-3e3d66339724 Jan 18 20:34:29.506426 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-602c1943-d897-4093-b239-060410ac8235 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "POST /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90/action" status: 202 len: 0 microversion: 2.1 time: 0.494137 Jan 18 20:34:29.507785 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 512/1027] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:34:29 2022] POST /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 18 20:34:29.517319 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6dd345e1-7763-458d-926e-2b4630e06a55 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:29.518096 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6dd345e1-7763-458d-926e-2b4630e06a55 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:29.529430 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6dd345e1-7763-458d-926e-2b4630e06a55 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:29.529879 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6dd345e1-7763-458d-926e-2b4630e06a55 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:29.530674 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6dd345e1-7763-458d-926e-2b4630e06a55 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:29.531156 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6dd345e1-7763-458d-926e-2b4630e06a55 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:29.685426 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6dd345e1-7763-458d-926e-2b4630e06a55 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:29.694309 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6dd345e1-7763-458d-926e-2b4630e06a55 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1762 microversion: 2.1 time: 0.181789 Jan 18 20:34:29.695489 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 516/1028] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:29 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1762 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:30.046930 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-0a23a6f6-4b05-4d3d-9b2c-cc40d812f23b req-e5a8f249-1741-4da4-8520-ac90cb01a1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2293f505-4950-4219-ae01-fa3597af3e90", "tag": "d913cdd2-3b97-4121-9ee9-3e3d66339724"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:34:30.049047 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:34:30.049047 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:34:30.055884 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-0a23a6f6-4b05-4d3d-9b2c-cc40d812f23b req-e5a8f249-1741-4da4-8520-ac90cb01a1a5 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:30.056319 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-0a23a6f6-4b05-4d3d-9b2c-cc40d812f23b req-e5a8f249-1741-4da4-8520-ac90cb01a1a5 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:30.067068 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-0a23a6f6-4b05-4d3d-9b2c-cc40d812f23b req-e5a8f249-1741-4da4-8520-ac90cb01a1a5 service nova] Creating event network-changed:d913cdd2-3b97-4121-9ee9-3e3d66339724 for instance 2293f505-4950-4219-ae01-fa3597af3e90 on hv-cinder-82160 Jan 18 20:34:30.071955 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-0a23a6f6-4b05-4d3d-9b2c-cc40d812f23b req-e5a8f249-1741-4da4-8520-ac90cb01a1a5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029447 Jan 18 20:34:30.072705 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 513/1029] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:34:50.339988 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f6c74630-cc36-43a3-85a2-5a2ba0c6166b tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:50.340628 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f6c74630-cc36-43a3-85a2-5a2ba0c6166b tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:50.346969 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f6c74630-cc36-43a3-85a2-5a2ba0c6166b tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:50.347456 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f6c74630-cc36-43a3-85a2-5a2ba0c6166b tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:50.348242 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f6c74630-cc36-43a3-85a2-5a2ba0c6166b tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:50.348673 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f6c74630-cc36-43a3-85a2-5a2ba0c6166b tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:50.375866 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f6c74630-cc36-43a3-85a2-5a2ba0c6166b tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:34:50.448480 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f6c74630-cc36-43a3-85a2-5a2ba0c6166b tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "DELETE /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 204 len: 0 microversion: 2.1 time: 0.112133 Jan 18 20:34:50.449462 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 517/1030] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:34:50 2022] DELETE /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 18 20:34:50.460416 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-fc635996-8656-46cf-9a18-c6f7559acec7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:50.461712 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-fc635996-8656-46cf-9a18-c6f7559acec7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:50.467790 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fc635996-8656-46cf-9a18-c6f7559acec7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:50.468243 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fc635996-8656-46cf-9a18-c6f7559acec7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:50.469019 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fc635996-8656-46cf-9a18-c6f7559acec7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:50.469455 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-fc635996-8656-46cf-9a18-c6f7559acec7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:50.600615 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-fc635996-8656-46cf-9a18-c6f7559acec7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:50.608452 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-fc635996-8656-46cf-9a18-c6f7559acec7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1578 microversion: 2.1 time: 0.153107 Jan 18 20:34:50.609017 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 514/1031] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:50 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:51.626058 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ac889e0f-8066-483e-940d-3014f0776c13 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:51.626765 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ac889e0f-8066-483e-940d-3014f0776c13 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:51.633156 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ac889e0f-8066-483e-940d-3014f0776c13 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:51.633607 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ac889e0f-8066-483e-940d-3014f0776c13 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:51.634407 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ac889e0f-8066-483e-940d-3014f0776c13 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:51.634838 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ac889e0f-8066-483e-940d-3014f0776c13 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:51.783073 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ac889e0f-8066-483e-940d-3014f0776c13 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:51.793212 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ac889e0f-8066-483e-940d-3014f0776c13 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1578 microversion: 2.1 time: 0.171530 Jan 18 20:34:51.793793 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 518/1032] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:51 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:52.811092 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-cbed179d-e86a-42fc-a521-b75d6cc40b45 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:52.812606 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-cbed179d-e86a-42fc-a521-b75d6cc40b45 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:52.818041 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cbed179d-e86a-42fc-a521-b75d6cc40b45 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:52.818496 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cbed179d-e86a-42fc-a521-b75d6cc40b45 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:52.819341 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cbed179d-e86a-42fc-a521-b75d6cc40b45 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:52.819778 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-cbed179d-e86a-42fc-a521-b75d6cc40b45 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:52.887393 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-cbed179d-e86a-42fc-a521-b75d6cc40b45 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:52.894881 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-cbed179d-e86a-42fc-a521-b75d6cc40b45 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 200 len: 1511 microversion: 2.1 time: 0.087597 Jan 18 20:34:52.895489 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 515/1033] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:52 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 1511 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:53.014568 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b0414f0d-aaab-47a3-b286-91aec1879217 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:34:53.015611 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b0414f0d-aaab-47a3-b286-91aec1879217 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:53.022090 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0414f0d-aaab-47a3-b286-91aec1879217 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:53.022547 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0414f0d-aaab-47a3-b286-91aec1879217 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:53.023914 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0414f0d-aaab-47a3-b286-91aec1879217 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:53.024334 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0414f0d-aaab-47a3-b286-91aec1879217 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:53.103978 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b0414f0d-aaab-47a3-b286-91aec1879217 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "POST /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90/action" status: 202 len: 0 microversion: 2.1 time: 0.092627 Jan 18 20:34:53.107710 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 519/1034] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:34:53 2022] POST /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:34:53.113540 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6982163d-8f27-4e06-b090-a76b9963e1a1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:53.114869 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6982163d-8f27-4e06-b090-a76b9963e1a1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:53.115020 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [req-af63b50a-e653-41e4-818f-6ec5b37169b9 req-48c69a37-6ce9-4034-a11c-a6d4e7e7f46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda8f88c-10d2-4afa-9257-97a6d029f4bf", "name": "network-vif-deleted", "tag": "7d42978d-d72f-41b6-aced-e2a13e4efa4b"}]} {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:34:53.116520 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:34:53.116520 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: warnings.warn(msg) Jan 18 20:34:53.121646 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6982163d-8f27-4e06-b090-a76b9963e1a1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:53.122326 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6982163d-8f27-4e06-b090-a76b9963e1a1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:53.123392 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6982163d-8f27-4e06-b090-a76b9963e1a1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:53.124087 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6982163d-8f27-4e06-b090-a76b9963e1a1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:53.124530 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-af63b50a-e653-41e4-818f-6ec5b37169b9 req-48c69a37-6ce9-4034-a11c-a6d4e7e7f46d service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:53.125150 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [req-af63b50a-e653-41e4-818f-6ec5b37169b9 req-48c69a37-6ce9-4034-a11c-a6d4e7e7f46d service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:53.137526 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.compute.server_external_events [req-af63b50a-e653-41e4-818f-6ec5b37169b9 req-48c69a37-6ce9-4034-a11c-a6d4e7e7f46d service nova] Creating event network-vif-deleted:7d42978d-d72f-41b6-aced-e2a13e4efa4b for instance eda8f88c-10d2-4afa-9257-97a6d029f4bf on hv-cinder-82160 Jan 18 20:34:53.144805 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [req-af63b50a-e653-41e4-818f-6ec5b37169b9 req-48c69a37-6ce9-4034-a11c-a6d4e7e7f46d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039314 Jan 18 20:34:53.150566 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 516/1035] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:34:53.411681 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6982163d-8f27-4e06-b090-a76b9963e1a1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:53.423519 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6982163d-8f27-4e06-b090-a76b9963e1a1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1754 microversion: 2.1 time: 0.313465 Jan 18 20:34:53.424459 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 520/1036] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:53 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1754 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:53.914874 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-6fdbad39-f35d-4dee-a019-dcec8fb909e7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:53.916239 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-6fdbad39-f35d-4dee-a019-dcec8fb909e7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:53.923130 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6fdbad39-f35d-4dee-a019-dcec8fb909e7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:53.923577 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6fdbad39-f35d-4dee-a019-dcec8fb909e7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:53.924369 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6fdbad39-f35d-4dee-a019-dcec8fb909e7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:53.925045 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-6fdbad39-f35d-4dee-a019-dcec8fb909e7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:53.939681 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.wsgi [None req-6fdbad39-f35d-4dee-a019-dcec8fb909e7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] HTTP exception thrown: Instance eda8f88c-10d2-4afa-9257-97a6d029f4bf could not be found. Jan 18 20:34:53.940356 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-6fdbad39-f35d-4dee-a019-dcec8fb909e7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Returning 404 to user: Instance eda8f88c-10d2-4afa-9257-97a6d029f4bf could not be found. {{(pid=116376) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:34:53.941271 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-6fdbad39-f35d-4dee-a019-dcec8fb909e7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 404 len: 111 microversion: 2.1 time: 0.032448 Jan 18 20:34:53.941831 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 517/1037] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:53 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 18 20:34:54.051978 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e7712846-3c54-4831-8096-04c0951b94a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-425555479", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2140880239", "security_groups": [{"name": "tempest-secgroup-smoke-864406677"}], "block_device_mapping_v2": [{"uuid": "906f0ae9-7af3-4562-a7a9-de06b4d2e7a1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3d41f18b-a9a9-452f-a56b-ae5f33323ec9"}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:34:54.167286 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-e7712846-3c54-4831-8096-04c0951b94a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] validate_networks() for [('3d41f18b-a9a9-452f-a56b-ae5f33323ec9', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:34:54.441471 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-5801484f-ea90-486d-837f-3a73beecadc8 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:54.442088 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-5801484f-ea90-486d-837f-3a73beecadc8 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:54.448642 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5801484f-ea90-486d-837f-3a73beecadc8 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:54.449093 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5801484f-ea90-486d-837f-3a73beecadc8 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:54.449881 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5801484f-ea90-486d-837f-3a73beecadc8 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:54.450323 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-5801484f-ea90-486d-837f-3a73beecadc8 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:54.596731 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-5801484f-ea90-486d-837f-3a73beecadc8 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:54.604701 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-5801484f-ea90-486d-837f-3a73beecadc8 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1759 microversion: 2.1 time: 0.166812 Jan 18 20:34:54.605278 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 518/1038] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:54 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:54.618739 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-e7712846-3c54-4831-8096-04c0951b94a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:34:54.619200 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-e7712846-3c54-4831-8096-04c0951b94a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:34:54.619753 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-e7712846-3c54-4831-8096-04c0951b94a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:34:54.620222 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-e7712846-3c54-4831-8096-04c0951b94a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:34:54.620528 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-e7712846-3c54-4831-8096-04c0951b94a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:34:54.629080 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e7712846-3c54-4831-8096-04c0951b94a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:54.629531 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e7712846-3c54-4831-8096-04c0951b94a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:54.630340 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e7712846-3c54-4831-8096-04c0951b94a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:54.630782 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e7712846-3c54-4831-8096-04c0951b94a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:54.647326 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-e7712846-3c54-4831-8096-04c0951b94a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Getting quotas for project 4da1bb9e68f340d5b32fa2a5916db726. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:34:54.651848 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-e7712846-3c54-4831-8096-04c0951b94a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Getting quotas for user 86f9f8e0b3374628a563831c0b74a06e and project 4da1bb9e68f340d5b32fa2a5916db726. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:34:54.706610 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e7712846-3c54-4831-8096-04c0951b94a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:34:54.708781 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e7712846-3c54-4831-8096-04c0951b94a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='906f0ae9-7af3-4562-a7a9-de06b4d2e7a1',volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:34:54.830227 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e7712846-3c54-4831-8096-04c0951b94a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.781925 Jan 18 20:34:54.830877 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 521/1039] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:34:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 18 20:34:54.845776 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-ce3b904f-8430-4b2d-87c8-5348e19961a0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:54.846307 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-ce3b904f-8430-4b2d-87c8-5348e19961a0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:54.898992 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-ce3b904f-8430-4b2d-87c8-5348e19961a0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:54.905736 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-ce3b904f-8430-4b2d-87c8-5348e19961a0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1094 microversion: 2.1 time: 0.068699 Jan 18 20:34:54.906421 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 519/1040] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:54 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:55.622123 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e09d4e4b-8e01-47fc-8981-137eed5eaaf0 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:55.622721 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e09d4e4b-8e01-47fc-8981-137eed5eaaf0 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:55.629983 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e09d4e4b-8e01-47fc-8981-137eed5eaaf0 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:55.630438 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e09d4e4b-8e01-47fc-8981-137eed5eaaf0 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:55.631254 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e09d4e4b-8e01-47fc-8981-137eed5eaaf0 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:55.631690 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e09d4e4b-8e01-47fc-8981-137eed5eaaf0 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:55.858769 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e09d4e4b-8e01-47fc-8981-137eed5eaaf0 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:55.866919 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e09d4e4b-8e01-47fc-8981-137eed5eaaf0 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1759 microversion: 2.1 time: 0.248622 Jan 18 20:34:55.867554 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 522/1041] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:55 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1759 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:55.922942 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-0b48e04e-bc8a-4d4e-bf09-3d643e2cf0b0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:55.924281 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-0b48e04e-bc8a-4d4e-bf09-3d643e2cf0b0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:55.930796 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0b48e04e-bc8a-4d4e-bf09-3d643e2cf0b0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:55.931370 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0b48e04e-bc8a-4d4e-bf09-3d643e2cf0b0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:55.932232 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0b48e04e-bc8a-4d4e-bf09-3d643e2cf0b0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:55.932767 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-0b48e04e-bc8a-4d4e-bf09-3d643e2cf0b0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:55.992715 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-0b48e04e-bc8a-4d4e-bf09-3d643e2cf0b0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:56.000587 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-0b48e04e-bc8a-4d4e-bf09-3d643e2cf0b0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1210 microversion: 2.1 time: 0.081706 Jan 18 20:34:56.001448 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 520/1042] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:55 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:56.884466 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-df1a9c3c-f4a9-41ed-a20a-1c4cce5ee60d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:56.885091 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-df1a9c3c-f4a9-41ed-a20a-1c4cce5ee60d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:56.892011 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df1a9c3c-f4a9-41ed-a20a-1c4cce5ee60d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:56.893232 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df1a9c3c-f4a9-41ed-a20a-1c4cce5ee60d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:56.894219 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df1a9c3c-f4a9-41ed-a20a-1c4cce5ee60d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:56.894767 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df1a9c3c-f4a9-41ed-a20a-1c4cce5ee60d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:57.019540 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-7134c4ef-261f-4baf-bf07-daab892f83c5 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:57.020261 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-7134c4ef-261f-4baf-bf07-daab892f83c5 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:57.034475 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7134c4ef-261f-4baf-bf07-daab892f83c5 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:57.035448 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7134c4ef-261f-4baf-bf07-daab892f83c5 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:57.036614 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7134c4ef-261f-4baf-bf07-daab892f83c5 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:57.037131 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-7134c4ef-261f-4baf-bf07-daab892f83c5 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:57.134940 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-df1a9c3c-f4a9-41ed-a20a-1c4cce5ee60d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:57.144770 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-df1a9c3c-f4a9-41ed-a20a-1c4cce5ee60d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1759 microversion: 2.1 time: 0.264503 Jan 18 20:34:57.155774 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 523/1043] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:56 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1759 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:57.186542 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-7134c4ef-261f-4baf-bf07-daab892f83c5 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:57.195744 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-2a393aae-a4c6-4093-94e7-30b21cb8a4fc req-c890d616-33ac-4bad-a323-167e3bd00e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa7d09a-3de7-4630-bf0a-49abaa11f513", "tag": "0570c490-8ec5-4d5d-8a99-7af6a5729f48"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:34:57.199109 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-7134c4ef-261f-4baf-bf07-daab892f83c5 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1265 microversion: 2.1 time: 0.180290 Jan 18 20:34:57.199719 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:34:57.199719 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:34:57.209619 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-2a393aae-a4c6-4093-94e7-30b21cb8a4fc req-c890d616-33ac-4bad-a323-167e3bd00e82 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:57.210269 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-2a393aae-a4c6-4093-94e7-30b21cb8a4fc req-c890d616-33ac-4bad-a323-167e3bd00e82 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:57.213286 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 521/1044] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:57 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:34:57.223960 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-2a393aae-a4c6-4093-94e7-30b21cb8a4fc req-c890d616-33ac-4bad-a323-167e3bd00e82 service nova] Creating event network-changed:0570c490-8ec5-4d5d-8a99-7af6a5729f48 for instance 1fa7d09a-3de7-4630-bf0a-49abaa11f513 on hv-cinder-82160 Jan 18 20:34:57.229360 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-2a393aae-a4c6-4093-94e7-30b21cb8a4fc req-c890d616-33ac-4bad-a323-167e3bd00e82 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037240 Jan 18 20:34:57.229937 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 524/1045] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:34:58.162462 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-c7d18b03-bb0f-4dfb-bda9-6859c4c04387 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:58.163106 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-c7d18b03-bb0f-4dfb-bda9-6859c4c04387 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:58.169997 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c7d18b03-bb0f-4dfb-bda9-6859c4c04387 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:58.170445 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c7d18b03-bb0f-4dfb-bda9-6859c4c04387 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:58.171518 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c7d18b03-bb0f-4dfb-bda9-6859c4c04387 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:58.171950 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-c7d18b03-bb0f-4dfb-bda9-6859c4c04387 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:58.217315 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0fff7a1c-6f67-4fec-a7db-3a66cd668117 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:58.218023 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0fff7a1c-6f67-4fec-a7db-3a66cd668117 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:58.224098 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0fff7a1c-6f67-4fec-a7db-3a66cd668117 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:58.224547 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0fff7a1c-6f67-4fec-a7db-3a66cd668117 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:58.225332 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0fff7a1c-6f67-4fec-a7db-3a66cd668117 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:58.225775 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0fff7a1c-6f67-4fec-a7db-3a66cd668117 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:58.314578 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.policy [None req-c7d18b03-bb0f-4dfb-bda9-6859c4c04387 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116376) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:58.322473 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: INFO nova.api.openstack.requestlog [None req-c7d18b03-bb0f-4dfb-bda9-6859c4c04387 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1759 microversion: 2.1 time: 0.163621 Jan 18 20:34:58.323063 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: [pid: 116376|app: 0|req: 522/1046] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:58 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:34:58.366870 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0fff7a1c-6f67-4fec-a7db-3a66cd668117 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:58.374793 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0fff7a1c-6f67-4fec-a7db-3a66cd668117 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1265 microversion: 2.1 time: 0.161869 Jan 18 20:34:58.375392 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 525/1047] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:58 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:34:59.339378 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.api.openstack.wsgi [None req-61105ddf-98fe-4b50-bd6e-464aac0dd5d7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116376) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:59.339987 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG nova.compute.api [None req-61105ddf-98fe-4b50-bd6e-464aac0dd5d7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116376) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:59.346556 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-61105ddf-98fe-4b50-bd6e-464aac0dd5d7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:59.347000 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-61105ddf-98fe-4b50-bd6e-464aac0dd5d7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:59.347823 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: DEBUG oslo_concurrency.lockutils [None req-61105ddf-98fe-4b50-bd6e-464aac0dd5d7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116376) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:59.352396 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: Traceback (most recent call last): Jan 18 20:34:59.352535 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jan 18 20:34:59.352535 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: timer() Jan 18 20:34:59.352535 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jan 18 20:34:59.352535 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: cb(*args, **kw) Jan 18 20:34:59.352535 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jan 18 20:34:59.352535 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: waiter.switch() Jan 18 20:34:59.352535 dv-cinder-821602-14-iscsi devstack@n-api.service[116376]: greenlet.error: cannot switch to a different thread Jan 18 20:34:59.394678 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6cdc9345-5929-4661-b024-0e9ec10ee1cb tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:34:59.395313 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6cdc9345-5929-4661-b024-0e9ec10ee1cb tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:34:59.404043 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6cdc9345-5929-4661-b024-0e9ec10ee1cb tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:59.404495 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6cdc9345-5929-4661-b024-0e9ec10ee1cb tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:59.405282 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6cdc9345-5929-4661-b024-0e9ec10ee1cb tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:34:59.405720 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6cdc9345-5929-4661-b024-0e9ec10ee1cb tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:34:59.533389 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6cdc9345-5929-4661-b024-0e9ec10ee1cb tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:34:59.540787 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6cdc9345-5929-4661-b024-0e9ec10ee1cb tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1265 microversion: 2.1 time: 0.149847 Jan 18 20:34:59.541429 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 526/1048] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:34:59 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:35:00.556956 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f281978d-9ebe-4cb6-b796-6207dcda4ba5 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:35:00.557651 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f281978d-9ebe-4cb6-b796-6207dcda4ba5 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:35:00.563820 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f281978d-9ebe-4cb6-b796-6207dcda4ba5 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:00.564271 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f281978d-9ebe-4cb6-b796-6207dcda4ba5 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:00.565048 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f281978d-9ebe-4cb6-b796-6207dcda4ba5 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:00.565495 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f281978d-9ebe-4cb6-b796-6207dcda4ba5 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:00.696349 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f281978d-9ebe-4cb6-b796-6207dcda4ba5 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:35:00.703680 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f281978d-9ebe-4cb6-b796-6207dcda4ba5 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1265 microversion: 2.1 time: 0.150432 Jan 18 20:35:00.704242 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 527/1049] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:35:00 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:35:01.721003 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d8838e2c-60f0-4afb-bba9-9ca25525958f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:35:01.721642 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d8838e2c-60f0-4afb-bba9-9ca25525958f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:35:01.727908 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d8838e2c-60f0-4afb-bba9-9ca25525958f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:01.728357 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d8838e2c-60f0-4afb-bba9-9ca25525958f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:01.729128 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d8838e2c-60f0-4afb-bba9-9ca25525958f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:01.729562 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d8838e2c-60f0-4afb-bba9-9ca25525958f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:01.858230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d8838e2c-60f0-4afb-bba9-9ca25525958f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:35:01.865619 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d8838e2c-60f0-4afb-bba9-9ca25525958f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1265 microversion: 2.1 time: 0.148419 Jan 18 20:35:01.866171 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 528/1050] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:35:01 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:35:02.882766 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ee55a03e-18ee-4725-acc0-373311135d33 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:35:02.883913 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ee55a03e-18ee-4725-acc0-373311135d33 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:35:02.890183 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ee55a03e-18ee-4725-acc0-373311135d33 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:02.890633 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ee55a03e-18ee-4725-acc0-373311135d33 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:02.891470 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ee55a03e-18ee-4725-acc0-373311135d33 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:02.891905 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ee55a03e-18ee-4725-acc0-373311135d33 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:03.020754 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ee55a03e-18ee-4725-acc0-373311135d33 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:35:03.028109 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ee55a03e-18ee-4725-acc0-373311135d33 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1265 microversion: 2.1 time: 0.148991 Jan 18 20:35:03.028674 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 529/1051] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:35:02 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:35:04.045485 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b330042b-8f9d-40d1-9c26-4e3b17d276d7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:35:04.046460 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b330042b-8f9d-40d1-9c26-4e3b17d276d7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:35:04.052771 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b330042b-8f9d-40d1-9c26-4e3b17d276d7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:04.053212 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b330042b-8f9d-40d1-9c26-4e3b17d276d7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:04.054004 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b330042b-8f9d-40d1-9c26-4e3b17d276d7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:04.054435 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b330042b-8f9d-40d1-9c26-4e3b17d276d7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:04.187666 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b330042b-8f9d-40d1-9c26-4e3b17d276d7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:35:04.194891 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b330042b-8f9d-40d1-9c26-4e3b17d276d7 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1265 microversion: 2.1 time: 0.153093 Jan 18 20:35:04.195502 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 530/1052] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:35:04 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:35:05.211112 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-59a64533-69e5-47c3-973e-f556cdf79e04 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:35:05.211782 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-59a64533-69e5-47c3-973e-f556cdf79e04 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:35:05.218425 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-59a64533-69e5-47c3-973e-f556cdf79e04 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:05.218873 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-59a64533-69e5-47c3-973e-f556cdf79e04 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:05.219690 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-59a64533-69e5-47c3-973e-f556cdf79e04 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:05.220124 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-59a64533-69e5-47c3-973e-f556cdf79e04 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:05.349422 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-59a64533-69e5-47c3-973e-f556cdf79e04 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:35:05.357808 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-59a64533-69e5-47c3-973e-f556cdf79e04 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1265 microversion: 2.1 time: 0.150421 Jan 18 20:35:05.358373 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 531/1053] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:35:05 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:35:06.374110 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-48edc53f-d8cd-4169-a453-601ff5f9da79 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:35:06.374749 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-48edc53f-d8cd-4169-a453-601ff5f9da79 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:35:06.380950 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-48edc53f-d8cd-4169-a453-601ff5f9da79 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:06.381394 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-48edc53f-d8cd-4169-a453-601ff5f9da79 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:06.382157 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-48edc53f-d8cd-4169-a453-601ff5f9da79 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:06.382586 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-48edc53f-d8cd-4169-a453-601ff5f9da79 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:06.523077 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-48edc53f-d8cd-4169-a453-601ff5f9da79 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:35:06.530648 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-48edc53f-d8cd-4169-a453-601ff5f9da79 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1265 microversion: 2.1 time: 0.160189 Jan 18 20:35:06.531252 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 532/1054] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:35:06 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:35:07.547606 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-85e690f7-cdb1-438c-9447-fc9456797519 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:35:07.548299 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-85e690f7-cdb1-438c-9447-fc9456797519 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:35:07.554386 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-85e690f7-cdb1-438c-9447-fc9456797519 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:07.554829 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-85e690f7-cdb1-438c-9447-fc9456797519 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:07.555621 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-85e690f7-cdb1-438c-9447-fc9456797519 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:07.556049 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-85e690f7-cdb1-438c-9447-fc9456797519 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:07.684496 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-85e690f7-cdb1-438c-9447-fc9456797519 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:35:07.691747 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-85e690f7-cdb1-438c-9447-fc9456797519 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1265 microversion: 2.1 time: 0.148067 Jan 18 20:35:07.692323 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 533/1055] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:35:07 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:35:08.240657 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-125deeb5-8c82-43dc-a6a4-37c2c8ed62a7 req-0dfee3ef-8b69-44e9-9d10-ccb9e77547f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa7d09a-3de7-4630-bf0a-49abaa11f513", "name": "network-vif-plugged", "status": "completed", "tag": "0570c490-8ec5-4d5d-8a99-7af6a5729f48"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:35:08.242189 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:35:08.242189 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:35:08.249001 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-125deeb5-8c82-43dc-a6a4-37c2c8ed62a7 req-0dfee3ef-8b69-44e9-9d10-ccb9e77547f4 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:08.249452 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-125deeb5-8c82-43dc-a6a4-37c2c8ed62a7 req-0dfee3ef-8b69-44e9-9d10-ccb9e77547f4 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:08.260694 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-125deeb5-8c82-43dc-a6a4-37c2c8ed62a7 req-0dfee3ef-8b69-44e9-9d10-ccb9e77547f4 service nova] Creating event network-vif-plugged:0570c490-8ec5-4d5d-8a99-7af6a5729f48 for instance 1fa7d09a-3de7-4630-bf0a-49abaa11f513 on hv-cinder-82160 Jan 18 20:35:08.265560 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-125deeb5-8c82-43dc-a6a4-37c2c8ed62a7 req-0dfee3ef-8b69-44e9-9d10-ccb9e77547f4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028605 Jan 18 20:35:08.266169 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 534/1056] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:35:08.709828 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4fbbdc1d-a46f-4875-b711-3c3368b63bd9 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:35:08.710530 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4fbbdc1d-a46f-4875-b711-3c3368b63bd9 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:35:08.717231 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4fbbdc1d-a46f-4875-b711-3c3368b63bd9 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:08.717708 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4fbbdc1d-a46f-4875-b711-3c3368b63bd9 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:08.718485 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4fbbdc1d-a46f-4875-b711-3c3368b63bd9 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:08.718921 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4fbbdc1d-a46f-4875-b711-3c3368b63bd9 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:08.847710 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4fbbdc1d-a46f-4875-b711-3c3368b63bd9 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:35:08.854980 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4fbbdc1d-a46f-4875-b711-3c3368b63bd9 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1265 microversion: 2.1 time: 0.149616 Jan 18 20:35:08.855568 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 535/1057] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:35:08 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:35:09.872696 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-968cab5d-46be-4cb6-9f1b-9472530cc04f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:35:09.874386 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-968cab5d-46be-4cb6-9f1b-9472530cc04f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:35:09.882577 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-968cab5d-46be-4cb6-9f1b-9472530cc04f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:09.883458 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-968cab5d-46be-4cb6-9f1b-9472530cc04f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:09.884590 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-968cab5d-46be-4cb6-9f1b-9472530cc04f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:09.885024 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-968cab5d-46be-4cb6-9f1b-9472530cc04f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:10.319783 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-968cab5d-46be-4cb6-9f1b-9472530cc04f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:35:10.328311 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-968cab5d-46be-4cb6-9f1b-9472530cc04f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1452 microversion: 2.1 time: 0.459311 Jan 18 20:35:10.328907 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 536/1058] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:35:09 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1452 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:35:10.346339 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-eb9dfedd-7306-44c7-9aac-6b891b6b2f67 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:35:10.346937 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-eb9dfedd-7306-44c7-9aac-6b891b6b2f67 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:35:10.353737 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb9dfedd-7306-44c7-9aac-6b891b6b2f67 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:10.354433 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb9dfedd-7306-44c7-9aac-6b891b6b2f67 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:10.355291 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb9dfedd-7306-44c7-9aac-6b891b6b2f67 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:10.355730 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb9dfedd-7306-44c7-9aac-6b891b6b2f67 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:10.491530 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-eb9dfedd-7306-44c7-9aac-6b891b6b2f67 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:35:10.499290 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-eb9dfedd-7306-44c7-9aac-6b891b6b2f67 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1452 microversion: 2.1 time: 0.157221 Jan 18 20:35:10.499857 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 537/1059] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:35:10 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:35:12.066642 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-4acc1442-ccad-4bd1-b351-16d493ce87ea req-08c6d9f7-11a8-4e36-914f-7885364f42dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa7d09a-3de7-4630-bf0a-49abaa11f513", "tag": "0570c490-8ec5-4d5d-8a99-7af6a5729f48"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:35:12.068310 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:35:12.068310 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:35:12.075762 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-4acc1442-ccad-4bd1-b351-16d493ce87ea req-08c6d9f7-11a8-4e36-914f-7885364f42dc service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:12.076212 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-4acc1442-ccad-4bd1-b351-16d493ce87ea req-08c6d9f7-11a8-4e36-914f-7885364f42dc service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:12.087159 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-4acc1442-ccad-4bd1-b351-16d493ce87ea req-08c6d9f7-11a8-4e36-914f-7885364f42dc service nova] Creating event network-changed:0570c490-8ec5-4d5d-8a99-7af6a5729f48 for instance 1fa7d09a-3de7-4630-bf0a-49abaa11f513 on hv-cinder-82160 Jan 18 20:35:12.092648 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-4acc1442-ccad-4bd1-b351-16d493ce87ea req-08c6d9f7-11a8-4e36-914f-7885364f42dc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030283 Jan 18 20:35:12.093243 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 538/1060] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:35:59.399728 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f377e4d4-0aa2-4751-b166-1911c1ebd1d1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:35:59.400441 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f377e4d4-0aa2-4751-b166-1911c1ebd1d1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:35:59.407255 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f377e4d4-0aa2-4751-b166-1911c1ebd1d1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:59.407706 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f377e4d4-0aa2-4751-b166-1911c1ebd1d1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:59.408490 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f377e4d4-0aa2-4751-b166-1911c1ebd1d1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:35:59.408936 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f377e4d4-0aa2-4751-b166-1911c1ebd1d1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:35:59.554291 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f377e4d4-0aa2-4751-b166-1911c1ebd1d1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:35:59.562503 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f377e4d4-0aa2-4751-b166-1911c1ebd1d1 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1762 microversion: 2.1 time: 0.167520 Jan 18 20:35:59.563083 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 539/1061] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:35:59 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1762 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:36:00.139786 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-382d15ca-96d9-4f9e-b01a-258c9058f9d3 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1510748836"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:36:00.140342 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-382d15ca-96d9-4f9e-b01a-258c9058f9d3 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:00.146343 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-382d15ca-96d9-4f9e-b01a-258c9058f9d3 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:00.146835 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-382d15ca-96d9-4f9e-b01a-258c9058f9d3 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:00.147644 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-382d15ca-96d9-4f9e-b01a-258c9058f9d3 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:00.148073 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-382d15ca-96d9-4f9e-b01a-258c9058f9d3 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:00.275713 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.network.security_group_api [None req-382d15ca-96d9-4f9e-b01a-258c9058f9d3 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Removing security group 03cb478f-d5bc-4e2d-8994-c7a140e4aa06 from port d913cdd2-3b97-4121-9ee9-3e3d66339724 Jan 18 20:36:00.614204 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-382d15ca-96d9-4f9e-b01a-258c9058f9d3 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "POST /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90/action" status: 202 len: 0 microversion: 2.1 time: 0.478129 Jan 18 20:36:00.615835 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 540/1062] 10.222.0.67 () {60 vars in 1277 bytes} [Tue Jan 18 20:36:00 2022] POST /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:36:00.623179 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-14221fd3-1e89-47cd-93f2-dc035ca36a2b req-061f2e5f-d78e-431b-94b4-71e20fde4976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2293f505-4950-4219-ae01-fa3597af3e90", "tag": "d913cdd2-3b97-4121-9ee9-3e3d66339724"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:36:00.631488 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:36:00.631488 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:36:00.642072 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-14221fd3-1e89-47cd-93f2-dc035ca36a2b req-061f2e5f-d78e-431b-94b4-71e20fde4976 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:00.642894 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-14221fd3-1e89-47cd-93f2-dc035ca36a2b req-061f2e5f-d78e-431b-94b4-71e20fde4976 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:00.657391 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-14221fd3-1e89-47cd-93f2-dc035ca36a2b req-061f2e5f-d78e-431b-94b4-71e20fde4976 service nova] Creating event network-changed:d913cdd2-3b97-4121-9ee9-3e3d66339724 for instance 2293f505-4950-4219-ae01-fa3597af3e90 on hv-cinder-82160 Jan 18 20:36:00.664250 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-14221fd3-1e89-47cd-93f2-dc035ca36a2b req-061f2e5f-d78e-431b-94b4-71e20fde4976 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045757 Jan 18 20:36:00.665719 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 541/1063] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:36:02.040568 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-110452c9-f95d-41ec-9821-11edeef47b9d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:02.041178 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-110452c9-f95d-41ec-9821-11edeef47b9d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:02.048284 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-110452c9-f95d-41ec-9821-11edeef47b9d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:02.048731 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-110452c9-f95d-41ec-9821-11edeef47b9d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:02.049503 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-110452c9-f95d-41ec-9821-11edeef47b9d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:02.049933 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-110452c9-f95d-41ec-9821-11edeef47b9d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:02.127466 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-110452c9-f95d-41ec-9821-11edeef47b9d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lazy-loading 'services' on Instance uuid 2293f505-4950-4219-ae01-fa3597af3e90 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:36:02.197560 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-110452c9-f95d-41ec-9821-11edeef47b9d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90/os-volume_attachments/5b444b82-8a56-4040-8ad6-19c57f749dc8" status: 202 len: 0 microversion: 2.1 time: 0.161093 Jan 18 20:36:02.198248 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 542/1064] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Jan 18 20:36:02 2022] DELETE /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90/os-volume_attachments/5b444b82-8a56-4040-8ad6-19c57f749dc8 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:36:02.204406 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-f8e83fbb-05ec-4a37-b2db-90642ae75ecb req-f0ac55ea-ff04-4193-991d-ca1c60cfb44b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2293f505-4950-4219-ae01-fa3597af3e90", "tag": "d913cdd2-3b97-4121-9ee9-3e3d66339724"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:36:02.207829 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:36:02.207829 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:36:02.219297 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-f8e83fbb-05ec-4a37-b2db-90642ae75ecb req-f0ac55ea-ff04-4193-991d-ca1c60cfb44b service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:02.219746 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-f8e83fbb-05ec-4a37-b2db-90642ae75ecb req-f0ac55ea-ff04-4193-991d-ca1c60cfb44b service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:02.231342 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-f8e83fbb-05ec-4a37-b2db-90642ae75ecb req-f0ac55ea-ff04-4193-991d-ca1c60cfb44b service nova] Creating event network-changed:d913cdd2-3b97-4121-9ee9-3e3d66339724 for instance 2293f505-4950-4219-ae01-fa3597af3e90 on hv-cinder-82160 Jan 18 20:36:02.236133 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-f8e83fbb-05ec-4a37-b2db-90642ae75ecb req-f0ac55ea-ff04-4193-991d-ca1c60cfb44b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036355 Jan 18 20:36:02.237054 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 543/1065] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:36:02.241896 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5f62faaa-5bbb-467c-8b1e-8dd20a6cc41d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:02.242892 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5f62faaa-5bbb-467c-8b1e-8dd20a6cc41d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:02.249910 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5f62faaa-5bbb-467c-8b1e-8dd20a6cc41d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:02.250353 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5f62faaa-5bbb-467c-8b1e-8dd20a6cc41d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:02.251416 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5f62faaa-5bbb-467c-8b1e-8dd20a6cc41d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:02.251890 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5f62faaa-5bbb-467c-8b1e-8dd20a6cc41d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:02.282404 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5f62faaa-5bbb-467c-8b1e-8dd20a6cc41d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044155 Jan 18 20:36:02.282994 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 544/1066] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:36:02 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:36:03.293809 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2ac8b56c-98b6-462b-880b-b0a7f47e699a tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:03.294713 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2ac8b56c-98b6-462b-880b-b0a7f47e699a tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:03.301850 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ac8b56c-98b6-462b-880b-b0a7f47e699a tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:03.302288 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ac8b56c-98b6-462b-880b-b0a7f47e699a tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:03.303076 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ac8b56c-98b6-462b-880b-b0a7f47e699a tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:03.303507 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ac8b56c-98b6-462b-880b-b0a7f47e699a tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:03.331416 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2ac8b56c-98b6-462b-880b-b0a7f47e699a tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041423 Jan 18 20:36:03.331960 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 545/1067] 10.222.0.67 () {58 vars in 1301 bytes} [Tue Jan 18 20:36:03 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 18 20:36:03.340952 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e4f77457-fc65-4af6-95fb-bbefeca09bc5 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:03.341431 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e4f77457-fc65-4af6-95fb-bbefeca09bc5 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:03.347190 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e4f77457-fc65-4af6-95fb-bbefeca09bc5 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:03.347633 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e4f77457-fc65-4af6-95fb-bbefeca09bc5 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:03.348398 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e4f77457-fc65-4af6-95fb-bbefeca09bc5 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:03.348824 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e4f77457-fc65-4af6-95fb-bbefeca09bc5 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:03.425583 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-e4f77457-fc65-4af6-95fb-bbefeca09bc5 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] HTTP exception thrown: Instance 2293f505-4950-4219-ae01-fa3597af3e90 is not attached to volume 5b444b82-8a56-4040-8ad6-19c57f749dc8 Jan 18 20:36:03.426167 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e4f77457-fc65-4af6-95fb-bbefeca09bc5 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Returning 404 to user: Instance 2293f505-4950-4219-ae01-fa3597af3e90 is not attached to volume 5b444b82-8a56-4040-8ad6-19c57f749dc8 {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:36:03.426992 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e4f77457-fc65-4af6-95fb-bbefeca09bc5 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90/os-volume_attachments/5b444b82-8a56-4040-8ad6-19c57f749dc8" status: 404 len: 154 microversion: 2.1 time: 0.089475 Jan 18 20:36:03.427562 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 546/1068] 10.222.0.67 () {58 vars in 1415 bytes} [Tue Jan 18 20:36:03 2022] DELETE /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90/os-volume_attachments/5b444b82-8a56-4040-8ad6-19c57f749dc8 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 18 20:36:04.551816 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ec0a93ff-924a-4884-b112-ce272a2e3848 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:04.552438 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ec0a93ff-924a-4884-b112-ce272a2e3848 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:04.558639 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ec0a93ff-924a-4884-b112-ce272a2e3848 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:04.559130 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ec0a93ff-924a-4884-b112-ce272a2e3848 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:04.559907 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ec0a93ff-924a-4884-b112-ce272a2e3848 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:04.560341 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ec0a93ff-924a-4884-b112-ce272a2e3848 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:04.585230 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ec0a93ff-924a-4884-b112-ce272a2e3848 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:36:04.659086 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ec0a93ff-924a-4884-b112-ce272a2e3848 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 204 len: 0 microversion: 2.1 time: 0.110556 Jan 18 20:36:04.659849 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 547/1069] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:36:04 2022] DELETE /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 18 20:36:04.668387 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0eb07af9-d2ff-47ec-8025-964373fc9703 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:04.669092 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0eb07af9-d2ff-47ec-8025-964373fc9703 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:04.675396 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0eb07af9-d2ff-47ec-8025-964373fc9703 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:04.675849 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0eb07af9-d2ff-47ec-8025-964373fc9703 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:04.676629 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0eb07af9-d2ff-47ec-8025-964373fc9703 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:04.677067 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0eb07af9-d2ff-47ec-8025-964373fc9703 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:04.808188 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0eb07af9-d2ff-47ec-8025-964373fc9703 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:36:04.816160 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0eb07af9-d2ff-47ec-8025-964373fc9703 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1556 microversion: 2.1 time: 0.151782 Jan 18 20:36:04.816714 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 548/1070] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:36:04 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:36:05.835712 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b51b8728-dcfa-455c-8b6f-84d95a8c2b1d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:05.836612 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b51b8728-dcfa-455c-8b6f-84d95a8c2b1d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:05.842932 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b51b8728-dcfa-455c-8b6f-84d95a8c2b1d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:05.844053 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b51b8728-dcfa-455c-8b6f-84d95a8c2b1d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:05.844813 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b51b8728-dcfa-455c-8b6f-84d95a8c2b1d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:05.845237 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b51b8728-dcfa-455c-8b6f-84d95a8c2b1d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:05.977077 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b51b8728-dcfa-455c-8b6f-84d95a8c2b1d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:36:05.984923 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b51b8728-dcfa-455c-8b6f-84d95a8c2b1d tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1556 microversion: 2.1 time: 0.154428 Jan 18 20:36:05.985489 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 549/1071] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:36:05 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:36:07.001859 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c7ef8e2f-22d7-4376-b818-b1833cb8b9b8 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:07.002503 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c7ef8e2f-22d7-4376-b818-b1833cb8b9b8 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:07.009182 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7ef8e2f-22d7-4376-b818-b1833cb8b9b8 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:07.010442 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7ef8e2f-22d7-4376-b818-b1833cb8b9b8 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:07.011269 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7ef8e2f-22d7-4376-b818-b1833cb8b9b8 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:07.011702 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7ef8e2f-22d7-4376-b818-b1833cb8b9b8 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:07.102351 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c7ef8e2f-22d7-4376-b818-b1833cb8b9b8 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94873063908142a59d23fdcbb44b1376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf494b30e744b9d83b873fae342275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:36:07.110902 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c7ef8e2f-22d7-4376-b818-b1833cb8b9b8 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 200 len: 1514 microversion: 2.1 time: 0.112714 Jan 18 20:36:07.111512 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 550/1072] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:36:06 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 1514 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:36:07.117028 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-58829d75-eac0-486c-ad3d-0adc61343e4a req-457e032b-ad76-47e5-a6dc-146af9273ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2293f505-4950-4219-ae01-fa3597af3e90", "name": "network-vif-deleted", "tag": "d913cdd2-3b97-4121-9ee9-3e3d66339724"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:36:07.118917 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:36:07.118917 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:36:07.126325 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-58829d75-eac0-486c-ad3d-0adc61343e4a req-457e032b-ad76-47e5-a6dc-146af9273ba7 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:07.126774 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-58829d75-eac0-486c-ad3d-0adc61343e4a req-457e032b-ad76-47e5-a6dc-146af9273ba7 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:07.138062 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-58829d75-eac0-486c-ad3d-0adc61343e4a req-457e032b-ad76-47e5-a6dc-146af9273ba7 service nova] Creating event network-vif-deleted:d913cdd2-3b97-4121-9ee9-3e3d66339724 for instance 2293f505-4950-4219-ae01-fa3597af3e90 on hv-cinder-82160 Jan 18 20:36:07.143446 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-58829d75-eac0-486c-ad3d-0adc61343e4a req-457e032b-ad76-47e5-a6dc-146af9273ba7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030752 Jan 18 20:36:07.144219 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 551/1073] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:36:08.129712 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2073c756-a5a8-4533-84d6-674b3a285ba7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:08.130355 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2073c756-a5a8-4533-84d6-674b3a285ba7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] [instance: 2293f505-4950-4219-ae01-fa3597af3e90] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:08.136518 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2073c756-a5a8-4533-84d6-674b3a285ba7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:08.136969 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2073c756-a5a8-4533-84d6-674b3a285ba7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:08.137745 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2073c756-a5a8-4533-84d6-674b3a285ba7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:08.138188 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2073c756-a5a8-4533-84d6-674b3a285ba7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:08.151107 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-2073c756-a5a8-4533-84d6-674b3a285ba7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] HTTP exception thrown: Instance 2293f505-4950-4219-ae01-fa3597af3e90 could not be found. Jan 18 20:36:08.151692 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2073c756-a5a8-4533-84d6-674b3a285ba7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Returning 404 to user: Instance 2293f505-4950-4219-ae01-fa3597af3e90 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:36:08.152504 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2073c756-a5a8-4533-84d6-674b3a285ba7 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90" status: 404 len: 111 microversion: 2.1 time: 0.027478 Jan 18 20:36:08.153031 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 552/1074] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:36:08 2022] GET /compute/v2.1/servers/2293f505-4950-4219-ae01-fa3597af3e90 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 18 20:36:08.161081 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-57b0067f-74f0-49c7-bc0b-bfb1b5d16ec4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] Calling method '.version_select at 0x7f1782e25a60>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:08.178739 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-57b0067f-74f0-49c7-bc0b-bfb1b5d16ec4 tempest-TestMinimumBasicScenario-1452064025 tempest-TestMinimumBasicScenario-1452064025-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1691686529" status: 202 len: 0 microversion: 2.1 time: 0.020814 Jan 18 20:36:08.179334 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 553/1075] 10.222.0.67 () {58 vars in 1271 bytes} [Tue Jan 18 20:36:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1691686529 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:36:48.221098 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-577fc768-2ae8-4222-aab7-196e21157181 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1123493071", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2140880239", "security_groups": [{"name": "tempest-secgroup-smoke-864406677"}], "block_device_mapping_v2": [{"uuid": "ca8ef9f7-0284-493e-8567-d569ee900a43", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3d41f18b-a9a9-452f-a56b-ae5f33323ec9"}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:36:48.332666 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-577fc768-2ae8-4222-aab7-196e21157181 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] validate_networks() for [('3d41f18b-a9a9-452f-a56b-ae5f33323ec9', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 18 20:36:48.696405 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-577fc768-2ae8-4222-aab7-196e21157181 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 18 20:36:48.696823 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-577fc768-2ae8-4222-aab7-196e21157181 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 18 20:36:48.697295 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-577fc768-2ae8-4222-aab7-196e21157181 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 18 20:36:48.697729 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-577fc768-2ae8-4222-aab7-196e21157181 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 18 20:36:48.698138 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-577fc768-2ae8-4222-aab7-196e21157181 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 18 20:36:48.706605 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-577fc768-2ae8-4222-aab7-196e21157181 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:48.707064 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-577fc768-2ae8-4222-aab7-196e21157181 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:48.707875 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-577fc768-2ae8-4222-aab7-196e21157181 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:48.708303 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-577fc768-2ae8-4222-aab7-196e21157181 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:48.729035 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-577fc768-2ae8-4222-aab7-196e21157181 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Getting quotas for project 4da1bb9e68f340d5b32fa2a5916db726. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 18 20:36:48.735354 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-577fc768-2ae8-4222-aab7-196e21157181 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Getting quotas for user 86f9f8e0b3374628a563831c0b74a06e and project 4da1bb9e68f340d5b32fa2a5916db726. Resources: {'cores', 'ram', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 18 20:36:48.788495 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-577fc768-2ae8-4222-aab7-196e21157181 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 18 20:36:48.790665 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-577fc768-2ae8-4222-aab7-196e21157181 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca8ef9f7-0284-493e-8567-d569ee900a43',volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 18 20:36:48.911690 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-577fc768-2ae8-4222-aab7-196e21157181 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.694182 Jan 18 20:36:48.912334 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 554/1076] 10.222.0.67 () {60 vars in 1146 bytes} [Tue Jan 18 20:36:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 18 20:36:48.922575 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-72000235-8b77-4be0-9b0c-0ea981c1a776 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:48.923219 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-72000235-8b77-4be0-9b0c-0ea981c1a776 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:48.974272 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-72000235-8b77-4be0-9b0c-0ea981c1a776 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:36:48.980783 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-72000235-8b77-4be0-9b0c-0ea981c1a776 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1095 microversion: 2.1 time: 0.062323 Jan 18 20:36:48.981649 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 555/1077] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:36:48 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:36:49.997905 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ecc4b9df-7067-4da7-a7f5-f4e0f08e037a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:49.998579 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ecc4b9df-7067-4da7-a7f5-f4e0f08e037a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:50.005673 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ecc4b9df-7067-4da7-a7f5-f4e0f08e037a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:50.006130 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ecc4b9df-7067-4da7-a7f5-f4e0f08e037a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:50.006935 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ecc4b9df-7067-4da7-a7f5-f4e0f08e037a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:50.007404 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ecc4b9df-7067-4da7-a7f5-f4e0f08e037a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:50.074565 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ecc4b9df-7067-4da7-a7f5-f4e0f08e037a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:36:50.082034 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ecc4b9df-7067-4da7-a7f5-f4e0f08e037a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1211 microversion: 2.1 time: 0.088203 Jan 18 20:36:50.082635 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 556/1078] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:36:49 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:36:51.100853 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8bfb9f2d-58be-4066-b887-cc83ea568604 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:51.103630 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8bfb9f2d-58be-4066-b887-cc83ea568604 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:51.111110 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8bfb9f2d-58be-4066-b887-cc83ea568604 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:51.111707 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8bfb9f2d-58be-4066-b887-cc83ea568604 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:51.112545 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8bfb9f2d-58be-4066-b887-cc83ea568604 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:51.112987 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8bfb9f2d-58be-4066-b887-cc83ea568604 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:51.333483 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8bfb9f2d-58be-4066-b887-cc83ea568604 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:36:51.344381 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8bfb9f2d-58be-4066-b887-cc83ea568604 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1266 microversion: 2.1 time: 0.247156 Jan 18 20:36:51.344977 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 557/1079] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:36:51 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:36:51.490190 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-a71e8aa8-3992-424c-bd2c-19dd815d641d req-19ae1171-8b7e-4565-b691-d8b413fd43ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94f68752-35ea-4c9d-a272-2f48510c03f1", "tag": "cc859e99-6305-4903-9e9f-b31f1249a103"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:36:51.491852 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:36:51.491852 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:36:51.498885 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-a71e8aa8-3992-424c-bd2c-19dd815d641d req-19ae1171-8b7e-4565-b691-d8b413fd43ab service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:51.499642 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-a71e8aa8-3992-424c-bd2c-19dd815d641d req-19ae1171-8b7e-4565-b691-d8b413fd43ab service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:51.511150 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-a71e8aa8-3992-424c-bd2c-19dd815d641d req-19ae1171-8b7e-4565-b691-d8b413fd43ab service nova] Creating event network-changed:cc859e99-6305-4903-9e9f-b31f1249a103 for instance 94f68752-35ea-4c9d-a272-2f48510c03f1 on hv-cinder-82160 Jan 18 20:36:51.516080 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-a71e8aa8-3992-424c-bd2c-19dd815d641d req-19ae1171-8b7e-4565-b691-d8b413fd43ab service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170002 Jan 18 20:36:51.516832 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 558/1080] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:36:52.362976 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e0a78797-db89-4301-882d-09a28d1ec974 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:52.363664 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e0a78797-db89-4301-882d-09a28d1ec974 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:52.370147 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e0a78797-db89-4301-882d-09a28d1ec974 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:52.370593 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e0a78797-db89-4301-882d-09a28d1ec974 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:52.371543 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e0a78797-db89-4301-882d-09a28d1ec974 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:52.372320 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e0a78797-db89-4301-882d-09a28d1ec974 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:52.507118 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e0a78797-db89-4301-882d-09a28d1ec974 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:36:52.514490 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e0a78797-db89-4301-882d-09a28d1ec974 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1266 microversion: 2.1 time: 0.156265 Jan 18 20:36:52.515074 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 559/1081] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:36:52 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:36:53.530726 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-eb245817-8721-4004-b9db-865c153719c0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:53.532038 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-eb245817-8721-4004-b9db-865c153719c0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:53.538427 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb245817-8721-4004-b9db-865c153719c0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:53.538866 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb245817-8721-4004-b9db-865c153719c0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:53.539716 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb245817-8721-4004-b9db-865c153719c0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:53.540151 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb245817-8721-4004-b9db-865c153719c0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:53.676703 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-eb245817-8721-4004-b9db-865c153719c0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:36:53.683964 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-eb245817-8721-4004-b9db-865c153719c0 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1266 microversion: 2.1 time: 0.156896 Jan 18 20:36:53.684530 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 560/1082] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:36:53 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:36:54.700433 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ca747c71-c40e-47f0-a1f2-ef240e4ad0d4 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:54.701084 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ca747c71-c40e-47f0-a1f2-ef240e4ad0d4 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:54.707335 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca747c71-c40e-47f0-a1f2-ef240e4ad0d4 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:54.707792 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca747c71-c40e-47f0-a1f2-ef240e4ad0d4 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:54.708568 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca747c71-c40e-47f0-a1f2-ef240e4ad0d4 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:54.709004 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca747c71-c40e-47f0-a1f2-ef240e4ad0d4 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:54.839063 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ca747c71-c40e-47f0-a1f2-ef240e4ad0d4 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:36:54.846849 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ca747c71-c40e-47f0-a1f2-ef240e4ad0d4 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1266 microversion: 2.1 time: 0.150122 Jan 18 20:36:54.847445 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 561/1083] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:36:54 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:36:55.865114 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8c72f1d4-e946-4f24-9dc4-f2361a7260f9 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:55.865768 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8c72f1d4-e946-4f24-9dc4-f2361a7260f9 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:55.872377 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c72f1d4-e946-4f24-9dc4-f2361a7260f9 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:55.872826 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c72f1d4-e946-4f24-9dc4-f2361a7260f9 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:55.873615 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c72f1d4-e946-4f24-9dc4-f2361a7260f9 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:55.874061 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c72f1d4-e946-4f24-9dc4-f2361a7260f9 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:56.008566 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8c72f1d4-e946-4f24-9dc4-f2361a7260f9 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:36:56.015969 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8c72f1d4-e946-4f24-9dc4-f2361a7260f9 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1266 microversion: 2.1 time: 0.154574 Jan 18 20:36:56.016522 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 562/1084] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:36:55 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:36:57.033363 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-04147a26-3cb2-4920-bd75-da0a382176f6 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:57.034023 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-04147a26-3cb2-4920-bd75-da0a382176f6 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:57.040357 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-04147a26-3cb2-4920-bd75-da0a382176f6 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:57.040801 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-04147a26-3cb2-4920-bd75-da0a382176f6 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:57.041577 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-04147a26-3cb2-4920-bd75-da0a382176f6 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:57.042009 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-04147a26-3cb2-4920-bd75-da0a382176f6 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:57.175092 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-04147a26-3cb2-4920-bd75-da0a382176f6 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:36:57.182468 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-04147a26-3cb2-4920-bd75-da0a382176f6 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1266 microversion: 2.1 time: 0.153325 Jan 18 20:36:57.183038 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 563/1085] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:36:57 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:36:58.199135 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-271ff232-991a-4364-b0d6-d3bef926fe1a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:58.199779 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-271ff232-991a-4364-b0d6-d3bef926fe1a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:58.205980 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-271ff232-991a-4364-b0d6-d3bef926fe1a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:58.206421 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-271ff232-991a-4364-b0d6-d3bef926fe1a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:58.207228 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-271ff232-991a-4364-b0d6-d3bef926fe1a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:58.207657 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-271ff232-991a-4364-b0d6-d3bef926fe1a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:58.337270 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-271ff232-991a-4364-b0d6-d3bef926fe1a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:36:58.344665 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-271ff232-991a-4364-b0d6-d3bef926fe1a tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1266 microversion: 2.1 time: 0.149250 Jan 18 20:36:58.345253 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 564/1086] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:36:58 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:36:59.361555 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b38a5de8-c2c9-4230-b223-e0997cd089a3 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:36:59.362235 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b38a5de8-c2c9-4230-b223-e0997cd089a3 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:36:59.368473 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b38a5de8-c2c9-4230-b223-e0997cd089a3 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:59.368917 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b38a5de8-c2c9-4230-b223-e0997cd089a3 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:59.369688 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b38a5de8-c2c9-4230-b223-e0997cd089a3 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:36:59.370118 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b38a5de8-c2c9-4230-b223-e0997cd089a3 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:36:59.502264 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b38a5de8-c2c9-4230-b223-e0997cd089a3 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:36:59.509655 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b38a5de8-c2c9-4230-b223-e0997cd089a3 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1266 microversion: 2.1 time: 0.151735 Jan 18 20:36:59.510217 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 565/1087] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:36:59 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:37:00.526181 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-227f75ef-51b6-4c45-bf71-c244d4412cd2 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:37:00.526851 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-227f75ef-51b6-4c45-bf71-c244d4412cd2 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:37:00.533886 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-227f75ef-51b6-4c45-bf71-c244d4412cd2 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:37:00.534342 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-227f75ef-51b6-4c45-bf71-c244d4412cd2 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:37:00.535162 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-227f75ef-51b6-4c45-bf71-c244d4412cd2 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:37:00.535600 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-227f75ef-51b6-4c45-bf71-c244d4412cd2 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:37:00.668623 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-227f75ef-51b6-4c45-bf71-c244d4412cd2 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:37:00.676183 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-227f75ef-51b6-4c45-bf71-c244d4412cd2 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1266 microversion: 2.1 time: 0.153683 Jan 18 20:37:00.676745 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 566/1088] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:37:00 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:37:01.692424 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c1353afd-5456-4a5f-8d60-815e259212ea tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:37:01.693067 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c1353afd-5456-4a5f-8d60-815e259212ea tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:37:01.699150 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c1353afd-5456-4a5f-8d60-815e259212ea tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:37:01.699594 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c1353afd-5456-4a5f-8d60-815e259212ea tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:37:01.700354 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c1353afd-5456-4a5f-8d60-815e259212ea tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:37:01.700779 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c1353afd-5456-4a5f-8d60-815e259212ea tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:37:01.827377 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c1353afd-5456-4a5f-8d60-815e259212ea tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:37:01.834730 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c1353afd-5456-4a5f-8d60-815e259212ea tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1266 microversion: 2.1 time: 0.146026 Jan 18 20:37:01.835330 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 567/1089] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:37:01 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:37:02.851417 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b8b77828-ddc5-4287-b8f2-aef8702f4aee tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:37:02.852201 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b8b77828-ddc5-4287-b8f2-aef8702f4aee tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:37:02.858667 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b8b77828-ddc5-4287-b8f2-aef8702f4aee tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:37:02.859141 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b8b77828-ddc5-4287-b8f2-aef8702f4aee tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:37:02.859934 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b8b77828-ddc5-4287-b8f2-aef8702f4aee tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:37:02.860366 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b8b77828-ddc5-4287-b8f2-aef8702f4aee tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:37:03.014017 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b8b77828-ddc5-4287-b8f2-aef8702f4aee tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:37:03.022024 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b8b77828-ddc5-4287-b8f2-aef8702f4aee tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1266 microversion: 2.1 time: 0.174371 Jan 18 20:37:03.022624 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 568/1090] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:37:02 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:37:03.026933 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-65822987-1bdc-48b3-8e5c-1810b953955f req-1f3edf4e-ee8c-4ce1-a8d5-3b3d3e7797c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f68752-35ea-4c9d-a272-2f48510c03f1", "name": "network-vif-plugged", "status": "completed", "tag": "cc859e99-6305-4903-9e9f-b31f1249a103"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:37:03.028520 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:37:03.028520 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:37:03.035107 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-65822987-1bdc-48b3-8e5c-1810b953955f req-1f3edf4e-ee8c-4ce1-a8d5-3b3d3e7797c4 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:37:03.035552 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-65822987-1bdc-48b3-8e5c-1810b953955f req-1f3edf4e-ee8c-4ce1-a8d5-3b3d3e7797c4 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:37:03.048252 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-65822987-1bdc-48b3-8e5c-1810b953955f req-1f3edf4e-ee8c-4ce1-a8d5-3b3d3e7797c4 service nova] Creating event network-vif-plugged:cc859e99-6305-4903-9e9f-b31f1249a103 for instance 94f68752-35ea-4c9d-a272-2f48510c03f1 on hv-cinder-82160 Jan 18 20:37:03.053704 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-65822987-1bdc-48b3-8e5c-1810b953955f req-1f3edf4e-ee8c-4ce1-a8d5-3b3d3e7797c4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029958 Jan 18 20:37:03.054307 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 569/1091] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:37:04.039789 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-df4daaaf-2c69-40fd-964e-4399eb88cb7b tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:37:04.040570 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-df4daaaf-2c69-40fd-964e-4399eb88cb7b tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:37:04.047295 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df4daaaf-2c69-40fd-964e-4399eb88cb7b tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:37:04.047752 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df4daaaf-2c69-40fd-964e-4399eb88cb7b tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:37:04.048542 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df4daaaf-2c69-40fd-964e-4399eb88cb7b tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:37:04.049243 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df4daaaf-2c69-40fd-964e-4399eb88cb7b tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:37:04.184876 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-df4daaaf-2c69-40fd-964e-4399eb88cb7b tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:37:04.193167 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-df4daaaf-2c69-40fd-964e-4399eb88cb7b tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1266 microversion: 2.1 time: 0.157830 Jan 18 20:37:04.193743 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 570/1092] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:37:04 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:37:05.209560 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a4bd0f4f-2497-4f63-bfe7-029c6b26825f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:37:05.210204 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a4bd0f4f-2497-4f63-bfe7-029c6b26825f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:37:05.216651 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a4bd0f4f-2497-4f63-bfe7-029c6b26825f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:37:05.217113 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a4bd0f4f-2497-4f63-bfe7-029c6b26825f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:37:05.217897 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a4bd0f4f-2497-4f63-bfe7-029c6b26825f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:37:05.218334 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a4bd0f4f-2497-4f63-bfe7-029c6b26825f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:37:05.348689 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a4bd0f4f-2497-4f63-bfe7-029c6b26825f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:37:05.356264 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a4bd0f4f-2497-4f63-bfe7-029c6b26825f tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1454 microversion: 2.1 time: 0.150428 Jan 18 20:37:05.356830 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 571/1093] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:37:05 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:37:05.372164 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f29ee6aa-1d64-4b1a-86e1-19e9c5c6a366 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:37:05.372774 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f29ee6aa-1d64-4b1a-86e1-19e9c5c6a366 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:37:05.378775 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f29ee6aa-1d64-4b1a-86e1-19e9c5c6a366 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:37:05.379264 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f29ee6aa-1d64-4b1a-86e1-19e9c5c6a366 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:37:05.380044 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f29ee6aa-1d64-4b1a-86e1-19e9c5c6a366 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:37:05.380478 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f29ee6aa-1d64-4b1a-86e1-19e9c5c6a366 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:37:05.511717 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f29ee6aa-1d64-4b1a-86e1-19e9c5c6a366 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:37:05.519762 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f29ee6aa-1d64-4b1a-86e1-19e9c5c6a366 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1454 microversion: 2.1 time: 0.150955 Jan 18 20:37:05.520345 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 572/1094] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:37:05 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:37:07.391341 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-51006a71-488e-4a26-964e-cd2fcf046ea1 req-199ac34f-fa56-48a5-8965-0a81c17882d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94f68752-35ea-4c9d-a272-2f48510c03f1", "tag": "cc859e99-6305-4903-9e9f-b31f1249a103"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:37:07.392955 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:37:07.392955 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:37:07.399984 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-51006a71-488e-4a26-964e-cd2fcf046ea1 req-199ac34f-fa56-48a5-8965-0a81c17882d9 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:37:07.400423 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-51006a71-488e-4a26-964e-cd2fcf046ea1 req-199ac34f-fa56-48a5-8965-0a81c17882d9 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:37:07.411465 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-51006a71-488e-4a26-964e-cd2fcf046ea1 req-199ac34f-fa56-48a5-8965-0a81c17882d9 service nova] Creating event network-changed:cc859e99-6305-4903-9e9f-b31f1249a103 for instance 94f68752-35ea-4c9d-a272-2f48510c03f1 on hv-cinder-82160 Jan 18 20:37:07.416415 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-51006a71-488e-4a26-964e-cd2fcf046ea1 req-199ac34f-fa56-48a5-8965-0a81c17882d9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035023 Jan 18 20:37:07.417009 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 573/1095] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:38:37.585815 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-69862b2e-7cba-4153-807d-ae8522774d35 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:38:37.586484 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-69862b2e-7cba-4153-807d-ae8522774d35 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:38:37.592532 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-69862b2e-7cba-4153-807d-ae8522774d35 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:37.592985 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-69862b2e-7cba-4153-807d-ae8522774d35 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:37.593761 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-69862b2e-7cba-4153-807d-ae8522774d35 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:37.594199 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-69862b2e-7cba-4153-807d-ae8522774d35 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:37.618608 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-69862b2e-7cba-4153-807d-ae8522774d35 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:38:37.694528 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-69862b2e-7cba-4153-807d-ae8522774d35 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "DELETE /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 204 len: 0 microversion: 2.1 time: 0.113907 Jan 18 20:38:37.695126 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 574/1096] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:38:37 2022] DELETE /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 18 20:38:37.701049 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-d25c8533-f2c6-4e58-8381-987208d4aabc req-7ebf7c4f-21c2-46af-837e-253630d5de8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94f68752-35ea-4c9d-a272-2f48510c03f1", "tag": "cc859e99-6305-4903-9e9f-b31f1249a103"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:38:37.702719 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:38:37.702719 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:38:37.709433 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-d25c8533-f2c6-4e58-8381-987208d4aabc req-7ebf7c4f-21c2-46af-837e-253630d5de8e service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:37.709877 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-d25c8533-f2c6-4e58-8381-987208d4aabc req-7ebf7c4f-21c2-46af-837e-253630d5de8e service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:37.720631 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-d25c8533-f2c6-4e58-8381-987208d4aabc req-7ebf7c4f-21c2-46af-837e-253630d5de8e service nova] Creating event network-changed:cc859e99-6305-4903-9e9f-b31f1249a103 for instance 94f68752-35ea-4c9d-a272-2f48510c03f1 on hv-cinder-82160 Jan 18 20:38:37.725647 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-d25c8533-f2c6-4e58-8381-987208d4aabc req-7ebf7c4f-21c2-46af-837e-253630d5de8e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028739 Jan 18 20:38:37.726335 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 575/1097] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:38:37.731242 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-87a99a01-e836-4a13-8bce-98cca0b81d94 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:38:37.731937 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-87a99a01-e836-4a13-8bce-98cca0b81d94 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:38:37.738010 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-87a99a01-e836-4a13-8bce-98cca0b81d94 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:37.738461 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-87a99a01-e836-4a13-8bce-98cca0b81d94 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:37.739268 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-87a99a01-e836-4a13-8bce-98cca0b81d94 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:37.739706 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-87a99a01-e836-4a13-8bce-98cca0b81d94 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:38.204365 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-87a99a01-e836-4a13-8bce-98cca0b81d94 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:38:38.213176 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-87a99a01-e836-4a13-8bce-98cca0b81d94 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1579 microversion: 2.1 time: 0.485554 Jan 18 20:38:38.213760 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 576/1098] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:38:37 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1579 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:38:39.230095 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d727602f-67b0-46ef-8c1f-49a72cf3cc32 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:38:39.230713 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d727602f-67b0-46ef-8c1f-49a72cf3cc32 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:38:39.237005 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d727602f-67b0-46ef-8c1f-49a72cf3cc32 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:39.237447 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d727602f-67b0-46ef-8c1f-49a72cf3cc32 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:39.238221 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d727602f-67b0-46ef-8c1f-49a72cf3cc32 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:39.238654 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d727602f-67b0-46ef-8c1f-49a72cf3cc32 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:39.456768 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d727602f-67b0-46ef-8c1f-49a72cf3cc32 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:38:39.464327 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d727602f-67b0-46ef-8c1f-49a72cf3cc32 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 200 len: 1460 microversion: 2.1 time: 0.237928 Jan 18 20:38:39.464991 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 577/1099] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:38:39 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 1460 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:38:39.799715 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-bc07da82-eba1-4375-b8d8-9f7eea365bea req-a8fd1f89-c991-41fa-bcea-58ab46becd64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f68752-35ea-4c9d-a272-2f48510c03f1", "name": "network-vif-deleted", "tag": "cc859e99-6305-4903-9e9f-b31f1249a103"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:38:39.801586 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:38:39.801586 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:38:39.808630 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-bc07da82-eba1-4375-b8d8-9f7eea365bea req-a8fd1f89-c991-41fa-bcea-58ab46becd64 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:39.809066 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-bc07da82-eba1-4375-b8d8-9f7eea365bea req-a8fd1f89-c991-41fa-bcea-58ab46becd64 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:39.820384 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-bc07da82-eba1-4375-b8d8-9f7eea365bea req-a8fd1f89-c991-41fa-bcea-58ab46becd64 service nova] Creating event network-vif-deleted:cc859e99-6305-4903-9e9f-b31f1249a103 for instance 94f68752-35ea-4c9d-a272-2f48510c03f1 on hv-cinder-82160 Jan 18 20:38:39.825096 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-bc07da82-eba1-4375-b8d8-9f7eea365bea req-a8fd1f89-c991-41fa-bcea-58ab46becd64 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029748 Jan 18 20:38:39.825662 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 578/1100] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:38:40.483138 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0e01b44a-44f9-4ce5-9e10-4ae235653bfe tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:38:40.483834 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0e01b44a-44f9-4ce5-9e10-4ae235653bfe tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 94f68752-35ea-4c9d-a272-2f48510c03f1] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:38:40.490021 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0e01b44a-44f9-4ce5-9e10-4ae235653bfe tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:40.490467 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0e01b44a-44f9-4ce5-9e10-4ae235653bfe tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:40.491339 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0e01b44a-44f9-4ce5-9e10-4ae235653bfe tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:40.491777 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0e01b44a-44f9-4ce5-9e10-4ae235653bfe tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:40.505568 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-0e01b44a-44f9-4ce5-9e10-4ae235653bfe tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] HTTP exception thrown: Instance 94f68752-35ea-4c9d-a272-2f48510c03f1 could not be found. Jan 18 20:38:40.506160 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0e01b44a-44f9-4ce5-9e10-4ae235653bfe tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Returning 404 to user: Instance 94f68752-35ea-4c9d-a272-2f48510c03f1 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:38:40.506987 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0e01b44a-44f9-4ce5-9e10-4ae235653bfe tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1" status: 404 len: 111 microversion: 2.1 time: 0.029105 Jan 18 20:38:40.507556 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 579/1101] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:38:40 2022] GET /compute/v2.1/servers/94f68752-35ea-4c9d-a272-2f48510c03f1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 18 20:38:43.809940 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e08d8e6c-d2dd-48d9-a503-2ae601e5ce52 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:38:43.810539 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e08d8e6c-d2dd-48d9-a503-2ae601e5ce52 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:38:43.817036 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e08d8e6c-d2dd-48d9-a503-2ae601e5ce52 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:43.817593 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e08d8e6c-d2dd-48d9-a503-2ae601e5ce52 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:43.818432 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e08d8e6c-d2dd-48d9-a503-2ae601e5ce52 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:43.818935 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e08d8e6c-d2dd-48d9-a503-2ae601e5ce52 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:43.844275 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e08d8e6c-d2dd-48d9-a503-2ae601e5ce52 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 18 20:38:43.929585 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e08d8e6c-d2dd-48d9-a503-2ae601e5ce52 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 204 len: 0 microversion: 2.1 time: 0.123003 Jan 18 20:38:43.930493 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 580/1102] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:38:43 2022] DELETE /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 18 20:38:43.935802 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-ccdb26ca-b900-4041-8f7c-e7030330c7f5 req-7d8aedac-3cdb-491e-a8ae-02c070cdd80e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa7d09a-3de7-4630-bf0a-49abaa11f513", "tag": "0570c490-8ec5-4d5d-8a99-7af6a5729f48"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:38:43.937284 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:38:43.937284 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:38:43.944256 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-ccdb26ca-b900-4041-8f7c-e7030330c7f5 req-7d8aedac-3cdb-491e-a8ae-02c070cdd80e service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:43.944694 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-ccdb26ca-b900-4041-8f7c-e7030330c7f5 req-7d8aedac-3cdb-491e-a8ae-02c070cdd80e service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:43.956207 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-ccdb26ca-b900-4041-8f7c-e7030330c7f5 req-7d8aedac-3cdb-491e-a8ae-02c070cdd80e service nova] Creating event network-changed:0570c490-8ec5-4d5d-8a99-7af6a5729f48 for instance 1fa7d09a-3de7-4630-bf0a-49abaa11f513 on hv-cinder-82160 Jan 18 20:38:43.961314 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-ccdb26ca-b900-4041-8f7c-e7030330c7f5 req-7d8aedac-3cdb-491e-a8ae-02c070cdd80e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029629 Jan 18 20:38:43.961899 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 581/1103] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 18 20:38:43.966725 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-25421c95-ea2c-416b-a9a7-2e6c7080fa22 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:38:43.967435 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-25421c95-ea2c-416b-a9a7-2e6c7080fa22 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:38:43.974239 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-25421c95-ea2c-416b-a9a7-2e6c7080fa22 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:43.974676 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-25421c95-ea2c-416b-a9a7-2e6c7080fa22 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:43.975502 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-25421c95-ea2c-416b-a9a7-2e6c7080fa22 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:43.975927 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-25421c95-ea2c-416b-a9a7-2e6c7080fa22 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:44.188057 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-25421c95-ea2c-416b-a9a7-2e6c7080fa22 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:38:44.195996 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-25421c95-ea2c-416b-a9a7-2e6c7080fa22 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1577 microversion: 2.1 time: 0.232934 Jan 18 20:38:44.196870 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 582/1104] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:38:43 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1577 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 18 20:38:45.213042 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6d29522d-1f70-4fc8-bcd6-66ed8a801b91 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:38:45.213757 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6d29522d-1f70-4fc8-bcd6-66ed8a801b91 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:38:45.219950 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6d29522d-1f70-4fc8-bcd6-66ed8a801b91 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:45.220396 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6d29522d-1f70-4fc8-bcd6-66ed8a801b91 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:45.221172 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6d29522d-1f70-4fc8-bcd6-66ed8a801b91 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:45.221603 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6d29522d-1f70-4fc8-bcd6-66ed8a801b91 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:45.353482 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6d29522d-1f70-4fc8-bcd6-66ed8a801b91 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:38:45.360923 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6d29522d-1f70-4fc8-bcd6-66ed8a801b91 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1458 microversion: 2.1 time: 0.151511 Jan 18 20:38:45.361485 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 583/1105] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:38:45 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1458 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:38:45.890380 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-1a763a6a-b69b-4485-bebe-e3d9f4016170 req-46fd0c2e-2e0d-4f47-8d92-f9b943c0dad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa7d09a-3de7-4630-bf0a-49abaa11f513", "name": "network-vif-deleted", "tag": "0570c490-8ec5-4d5d-8a99-7af6a5729f48"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 18 20:38:45.892083 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 20:38:45.892083 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 18 20:38:45.899357 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-1a763a6a-b69b-4485-bebe-e3d9f4016170 req-46fd0c2e-2e0d-4f47-8d92-f9b943c0dad7 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:45.899798 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-1a763a6a-b69b-4485-bebe-e3d9f4016170 req-46fd0c2e-2e0d-4f47-8d92-f9b943c0dad7 service nova] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:45.912921 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-1a763a6a-b69b-4485-bebe-e3d9f4016170 req-46fd0c2e-2e0d-4f47-8d92-f9b943c0dad7 service nova] Creating event network-vif-deleted:0570c490-8ec5-4d5d-8a99-7af6a5729f48 for instance 1fa7d09a-3de7-4630-bf0a-49abaa11f513 on hv-cinder-82160 Jan 18 20:38:45.919545 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-1a763a6a-b69b-4485-bebe-e3d9f4016170 req-46fd0c2e-2e0d-4f47-8d92-f9b943c0dad7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032735 Jan 18 20:38:45.920265 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 584/1106] 10.222.0.67 () {64 vars in 1317 bytes} [Tue Jan 18 20:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 18 20:38:46.378280 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bb221a7f-04cf-4b53-8332-3e6fa180dcba tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:38:46.378978 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bb221a7f-04cf-4b53-8332-3e6fa180dcba tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:38:46.386005 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb221a7f-04cf-4b53-8332-3e6fa180dcba tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:46.387136 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb221a7f-04cf-4b53-8332-3e6fa180dcba tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:46.388103 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb221a7f-04cf-4b53-8332-3e6fa180dcba tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:46.388549 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb221a7f-04cf-4b53-8332-3e6fa180dcba tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:46.419685 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb221a7f-04cf-4b53-8332-3e6fa180dcba tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:46.420080 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb221a7f-04cf-4b53-8332-3e6fa180dcba tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:46.420524 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-bb221a7f-04cf-4b53-8332-3e6fa180dcba tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lazy-loading 'fault' on Instance uuid 1fa7d09a-3de7-4630-bf0a-49abaa11f513 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 18 20:38:46.465135 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bb221a7f-04cf-4b53-8332-3e6fa180dcba tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9f8e0b3374628a563831c0b74a06e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da1bb9e68f340d5b32fa2a5916db726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 18 20:38:46.472574 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bb221a7f-04cf-4b53-8332-3e6fa180dcba tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 200 len: 1230 microversion: 2.1 time: 0.098252 Jan 18 20:38:46.473140 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 585/1107] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:38:46 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 18 20:38:47.488692 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d9820e49-fb8d-4e7f-8935-741a3f531844 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:38:47.489297 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d9820e49-fb8d-4e7f-8935-741a3f531844 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: 1fa7d09a-3de7-4630-bf0a-49abaa11f513] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:38:47.495517 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d9820e49-fb8d-4e7f-8935-741a3f531844 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:47.495963 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d9820e49-fb8d-4e7f-8935-741a3f531844 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:47.496728 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d9820e49-fb8d-4e7f-8935-741a3f531844 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:47.497157 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d9820e49-fb8d-4e7f-8935-741a3f531844 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:47.510027 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-d9820e49-fb8d-4e7f-8935-741a3f531844 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] HTTP exception thrown: Instance 1fa7d09a-3de7-4630-bf0a-49abaa11f513 could not be found. Jan 18 20:38:47.510594 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d9820e49-fb8d-4e7f-8935-741a3f531844 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Returning 404 to user: Instance 1fa7d09a-3de7-4630-bf0a-49abaa11f513 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:38:47.511430 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d9820e49-fb8d-4e7f-8935-741a3f531844 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513" status: 404 len: 111 microversion: 2.1 time: 0.026508 Jan 18 20:38:47.511944 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 586/1108] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:38:47 2022] GET /compute/v2.1/servers/1fa7d09a-3de7-4630-bf0a-49abaa11f513 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 18 20:38:47.935360 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-05d24291-58b7-4e63-bebd-40585ba5a87d tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:38:47.935869 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-05d24291-58b7-4e63-bebd-40585ba5a87d tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:38:47.941679 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05d24291-58b7-4e63-bebd-40585ba5a87d tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:47.942135 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05d24291-58b7-4e63-bebd-40585ba5a87d tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:47.942893 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05d24291-58b7-4e63-bebd-40585ba5a87d tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:47.943353 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05d24291-58b7-4e63-bebd-40585ba5a87d tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:47.956684 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-05d24291-58b7-4e63-bebd-40585ba5a87d tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] HTTP exception thrown: Instance eda8f88c-10d2-4afa-9257-97a6d029f4bf could not be found. Jan 18 20:38:47.957259 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-05d24291-58b7-4e63-bebd-40585ba5a87d tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Returning 404 to user: Instance eda8f88c-10d2-4afa-9257-97a6d029f4bf could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:38:47.958061 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-05d24291-58b7-4e63-bebd-40585ba5a87d tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "DELETE /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 404 len: 111 microversion: 2.1 time: 0.026655 Jan 18 20:38:47.958577 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 587/1109] 10.222.0.67 () {58 vars in 1238 bytes} [Tue Jan 18 20:38:47 2022] DELETE /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 18 20:38:47.966293 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8bfb9b94-4e9e-4985-bfa3-c98ec24900a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:38:47.966889 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8bfb9b94-4e9e-4985-bfa3-c98ec24900a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] [instance: eda8f88c-10d2-4afa-9257-97a6d029f4bf] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 18 20:38:47.972796 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8bfb9b94-4e9e-4985-bfa3-c98ec24900a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:47.973238 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8bfb9b94-4e9e-4985-bfa3-c98ec24900a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:47.973995 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8bfb9b94-4e9e-4985-bfa3-c98ec24900a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 18 20:38:47.974425 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8bfb9b94-4e9e-4985-bfa3-c98ec24900a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Lock "f3f10cc4-091c-4f8e-95bd-0bc3374e1059" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 18 20:38:47.986945 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-8bfb9b94-4e9e-4985-bfa3-c98ec24900a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] HTTP exception thrown: Instance eda8f88c-10d2-4afa-9257-97a6d029f4bf could not be found. Jan 18 20:38:47.987541 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8bfb9b94-4e9e-4985-bfa3-c98ec24900a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Returning 404 to user: Instance eda8f88c-10d2-4afa-9257-97a6d029f4bf could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 18 20:38:47.988330 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8bfb9b94-4e9e-4985-bfa3-c98ec24900a1 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf" status: 404 len: 111 microversion: 2.1 time: 0.025260 Jan 18 20:38:47.988834 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 588/1110] 10.222.0.67 () {58 vars in 1235 bytes} [Tue Jan 18 20:38:47 2022] GET /compute/v2.1/servers/eda8f88c-10d2-4afa-9257-97a6d029f4bf => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 18 20:38:49.258758 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1b669d6b-570d-47fd-92fa-c98adbcfad39 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] Calling method '.version_select at 0x7f1782dd33a0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 18 20:38:49.277463 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1b669d6b-570d-47fd-92fa-c98adbcfad39 tempest-TestVolumeBootPattern-1562459392 tempest-TestVolumeBootPattern-1562459392-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2140880239" status: 202 len: 0 microversion: 2.1 time: 0.022301 Jan 18 20:38:49.279245 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 589/1111] 10.222.0.67 () {58 vars in 1262 bytes} [Tue Jan 18 20:38:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2140880239 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 18 20:39:43.473687 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 20:39:43.474291 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: Tue Jan 18 20:39:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 20:41:47.749578 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 20:41:47.750294 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: Tue Jan 18 20:41:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 20:41:55.553708 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 20:41:55.554457 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: Tue Jan 18 20:41:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 18 20:43:03.481432 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 18 20:43:03.482005 dv-cinder-821602-14-iscsi devstack@n-api.service[116375]: Tue Jan 18 20:43:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!